Maxun v0.0.12 | Full Sized Browser, Faster Highlighting⚡

What's New

Full Sized Browser 🖥️

The browser now opens websites in full size to ensure no elements are missing

Faster & Smoother Highlighting ⚡

Optimized with caching & memoization, making the selection process more responsive.

What's Changed

• feat: unique queue robot run execution for users by @RohitR311 in #474
• fix: adjust margin for consistent spacing by @amhsirak in #483
• Feat: Resized Browser by @RohitR311 in #478
• feat: click next improvements by @RohitR311 in #482
• fix: attribute selection on link selections by @RohitR311 in #486
• feat: edit robot target url by @amhsirak in #485
• fix: excess gap between text fields by @amhsirak in #487
• fix: remote browser height sizing by @RohitR311 in #484
• feat: better DOM parsing and highlighting by @RohitR311 in #488
• feat: reduce highlighter thickness by @amhsirak in #490
• feat: enhance screencast quality by @amhsirak in #491
• fix: improve list container detection and highlighting by @RohitR311 in #493
• fix: session secret by @amhsirak in #494
• feat: migrate session storage to postgres by @amhsirak in #495
• docs: redis port minor changes by @ninja-programmer in #499
• feat: remote browser performance optimization by @RohitR311 in #496
• refactor: enhance RunsTable component layout by @theanuragg in #497
• fix: handling unexpected browser context closed error by @RohitR311 in #498
• feat: automate db migrations by @RohitR311 in #500
• chore: pre-release 0.0.12 by @amhsirak in #502
• revert db migrations by @RohitR311 in #504

New Contributors

• @theanuragg made their first contribution in #497

Full Changelog: v0.0.11...v0.0.12

Maxun v0.0.11 | Airtable Integration, Browser Performance Improvements +++

What's New

1. Airtable Integration 📊

Easily connect your robots to Airtable! Watch the video below to know more:

http://youtube.com/watch?v=Yf4Ifi2WuJk

DB Migration For Docker Users To Setup Airtable Integration

Steps to Manually Add airtable_base_id Column

Note: This is temporary as we will be automating db migrations

1. Run the following command inside the root folder of the project to access PostgreSQL:

   docker-compose exec postgres psql -U $DB_USER -d $DB_NAME

2. Inside the psql shell, run this SQL command to add the airtable_base_id column to the robot table:

   ALTER TABLE robot ADD COLUMN airtable_base_id TEXT;

3. Type \q to exit the psql shell.
4. Restart the container docker-compose up -d

2. Improved Browser Performance ⚡

We’ve made significant optimizations to enhance performance:

• Higher FPS: 10% increase for smoother rendering.
• Lower Event Latency: 32% faster, improving responsiveness.
• Memory Stability: No more increasing memory usage - it's now stable for consistent performance.

3. Infrastructure Enhancements 🏗️

• Concurrent Runs: Execute multiple workflows in parallel for better efficiency.
• Per-User Recording Sessions: Each user now gets a dedicated browser session recording, enabling more reliable extraction.

Enjoy the new improvements, and let us know your feedback! 🚀

What's Changed

• chore: release v0.0.10 by @amhsirak in #438
• fix: Api Key is not displayed by @RohitR311 in #452
• fix: Robot settings does not display by @RohitR311 in #451
• feat: airtable integration (core) by @AmitChauhan63390 in #420
• feat: airtable integration (follow up) by @amhsirak in #455
• chore: -rm migrations by @amhsirak in #456
• fix: display proxy config immediately after submission w/o hard refresh by @amhsirak in #454
• feat(i18n): integration translations by @amhsirak in #457
• fix: spacing between alert title and link by @amhsirak in #458
• feat: check for headers and append data to gsheet by @RohitR311 in #459
• fix: remove blue auto highlight in text fields by @amhsirak in #464
• feat: airtable environment variables by @amhsirak in #463
• feat: improve highlighting and data extraction by @RohitR311 in #462
• feat: support multiple browser instances by @amhsirak in #467
• fix: use runByUserId by @amhsirak in #468
• feat: sample env vars for airtable by @amhsirak in #471
• wip: performance by @amhsirak in #460
• feat: support redis auth by @amhsirak in #472
• fix: resolve handle url change by @RohitR311 in #475
• chore: pre-release v0.0.11 by @amhsirak in #476
• feat: browser perf log cleanup by @amhsirak in #477
• chore: release v0.0.11 by @amhsirak in #453

Full Changelog: v0.0.10...v0.0.11

Maxun v0.0.10 | Bug Fixes & Enhancements

What's Changed

• chore: -rm App.test.tsx by @amhsirak in #353
• chore: dead code elimination by @amhsirak in #350
• fix: broken coordinates import in date picker by @amhsirak in #351
• feat: handle invalid routes by @amhsirak in #354
• fix: page wrapper by @amhsirak in #355
• feat(ui): runs & robots loader by @amhsirak in #358
• fix: logo url by @amhsirak in #359
• feat: use new icons for toggle mode by @amhsirak in #360
• chore: docker cleanup by @amhsirak in #362
• feat: capitalize schedule by @amhsirak in #364
• fix: remove url creation and click race condition by @RohitR311 in #365
• feat: ability to update credentials for robots with authentication by @RohitR311 in #363
• fix: add condition for press actions by @RohitR311 in #370
• feat: change credentials based on input type by @RohitR311 in #375
• fix: add position of text for input click event by @RohitR311 in #378
• feat: db sync in dev mode by @amhsirak in #367
• feat: authentication prompt before robot creation by @amhsirak in #368
• feat: hide input values in edit robot by @RohitR311 in #384
• fix: prevent page reload on run trigger to open remote browser by @RohitR311 in #386
• fix: Empty label on recording shows error by @RohitR311 in #387
• Revert "fix: prevent page reload on run trigger to open remote browser" by @amhsirak in #388
• fix: open modal to fetch spreadsheets after google oauth by @RohitR311 in #390
• feat: edit robot inputs by @amhsirak in #385
• feat: order the input field logic to fix inputs by @RohitR311 in #393
• feat: reverting isLogin field changes by @RohitR311 in #394
• feat: use libgbm1 instead of libgbm-dev by @amhsirak in #395
• feat: optimize robots and runs table ui by @RohitR311 in #382
• feat: display loader on robot run by @RohitR311 in #398
• fix: Run status displays failed on system termination by @RohitR311 in #401
• feat: display proper message for run exists notification by @RohitR311 in #402
• feat: !show developer mode settings by @amhsirak in #400
• chore(ui): cleanup old theme by @amhsirak in #405
• feat(cloud): authenticated requests extend by @amhsirak in #412
• feat: remove project name from upgrade button by @amhsirak in #411
• feat: handle color=error in all modes by @amhsirak in #406
• feat: sort functionality for runs table data by @RohitR311 in #407
• feat: separate pagination for runs and nested runs by @RohitR311 in #415
• feat: sort robots and runs table by @RohitR311 in #419
• feat: remove star counter by @amhsirak in #421
• feat: display currently running robot run by @RohitR311 in #417
• feat: user menu revamp by @amhsirak in #422
• fix: alignment of nav items by @amhsirak in #423
• feat: prevent flickering of table ui on empty data by @RohitR311 in #425
• feat: prevent hard reload on robot edit and duplication by @RohitR311 in #427
• feat: center menus by @amhsirak in #429
• feat: better selection by @RohitR311 in #396
• fix: show better error message on user login by @RohitR311 in #428
• fix: use email instead of username by @amhsirak in #430
• feat: improve scraping stability by @RohitR311 in #403
• chore: pre-release 0.0.9 by @amhsirak in #431
• feat: consistent styling by @amhsirak in #432
• feat: toggle api key visibility by @amhsirak in #437
• chore: cleanup by @amhsirak in #442
• fix: login title translation by @amhsirak in #441
• feat: register translations by @amhsirak in #443
• feat: better error handling by @RohitR311 in #444
• feat: better error messages by @RohitR311 in #439
• feat: check limit while processing workflow by @RohitR311 in #440
• fix: handle displayed input texts by @RohitR311 in #435
• fix: add error handling for selector generation by @RohitR311 in #445
• fix: Return data even if single element exists by @RohitR311 in #446
• feat: navigate / by @amhsirak in #447
• fix: Authentication Error while Logging In by @RohitR311 in #449
• chore: pre-release 0.0.10 by @amhsirak in #450

Full Changelog: v0.0.9...v0.0.10

Maxun v0.0.9 | Bug Fixes & Enhancements

What's Changed

• feat: optimize robots and runs table ui by @RohitR311 in #382
• feat: display loader on robot run by @RohitR311 in #398
• fix: Run status displays failed on system termination by @RohitR311 in #401
• feat: display proper message for run exists notification by @RohitR311 in #402
• feat: !show developer mode settings by @amhsirak in #400
• chore(ui): cleanup old theme by @amhsirak in #405
• feat(cloud): authenticated requests extend by @amhsirak in #412
• feat: remove project name from upgrade button by @amhsirak in #411
• feat: handle color=error in all modes by @amhsirak in #406
• feat: sort functionality for runs table data by @RohitR311 in #407
• feat: separate pagination for runs and nested runs by @RohitR311 in #415
• feat: sort robots and runs table by @RohitR311 in #419
• feat: remove star counter by @amhsirak in #421
• feat: display currently running robot run by @RohitR311 in #417
• feat: user menu revamp by @amhsirak in #422
• fix: alignment of nav items by @amhsirak in #423
• feat: prevent flickering of table ui on empty data by @RohitR311 in #425
• feat: prevent hard reload on robot edit and duplication by @RohitR311 in #427
• feat: center menus by @amhsirak in #429
• feat: better selection by @RohitR311 in #396
• fix: show better error message on user login by @RohitR311 in #428
• fix: use email instead of username by @amhsirak in #430
• feat: improve scraping stability by @RohitR311 in #403
• chore: pre-release 0.0.9 by @amhsirak in #431
• chore: release v0.0.9 by @amhsirak in #399

Full Changelog: v0.0.8...v0.0.9

Maxun v0.0.8 | Editable Robot Inputs & Bug Fixes

What's New

Editable Robot Inputs

You can now edit all inputs provided during robot training! This includes usernames, passwords, emails, search terms, and more. With this update, robots become more dynamic and adaptable, ensuring smoother and more versatile data extraction.

Checkout this video to learn more: https://www.youtube.com/watch?v=BuHPbv3L0Yc

What's Changed

• chore: release v0.0.5 by @amhsirak in #261
• chore: release v0.0.6 by @amhsirak in #321
• chore: release v0.0.7 by @amhsirak in #335
• chore: -rm App.test.tsx by @amhsirak in #353
• chore: dead code elimination by @amhsirak in #350
• fix: broken coordinates import in date picker by @amhsirak in #351
• feat: handle invalid routes by @amhsirak in #354
• fix: page wrapper by @amhsirak in #355
• feat(ui): runs & robots loader by @amhsirak in #358
• fix: logo url by @amhsirak in #359
• feat: use new icons for toggle mode by @amhsirak in #360
• chore: docker cleanup by @amhsirak in #362
• feat: capitalize schedule by @amhsirak in #364
• fix: remove url creation and click race condition by @RohitR311 in #365
• feat: ability to update credentials for robots with authentication by @RohitR311 in #363
• fix: add condition for press actions by @RohitR311 in #370
• feat: change credentials based on input type by @RohitR311 in #375
• fix: add position of text for input click event by @RohitR311 in #378
• feat: db sync in dev mode by @amhsirak in #367
• feat: authentication prompt before robot creation by @amhsirak in #368
• feat: hide input values in edit robot by @RohitR311 in #384
• fix: prevent page reload on run trigger to open remote browser by @RohitR311 in #386
• fix: Empty label on recording shows error by @RohitR311 in #387
• Revert "fix: prevent page reload on run trigger to open remote browser" by @amhsirak in #388
• fix: open modal to fetch spreadsheets after google oauth by @RohitR311 in #390
• feat: edit robot inputs by @amhsirak in #385
• feat: order the input field logic to fix inputs by @RohitR311 in #393
• feat: reverting isLogin field changes by @RohitR311 in #394
• chore: pre-release 0.0.8 by @amhsirak in #392
• feat: use libgbm1 instead of libgbm-dev by @amhsirak in #395
• chore: release v0.0.8 by @amhsirak in #357

Full Changelog: v0.0.7...v0.0.8

Maxun v0.0.7 | Dark Theme, Arm64 Docker Support, Restart Recording Session +++

What's New

🌙 Dark Theme

Toggle between light and dark mode!

🔄 Restart Recording Session

Want to undo all captures in the current recording session? Now, you can simply "Restart Recording" instead of discarding and creating a new recording session.

⚙️ Arm64 Docker Support

Highly requested by the community. Maxun can now be run and deployed on ARM-based environments such as Raspberry Pi, AWS Graviton, and Apple M-series chips.

🤩 Better Pagination Selection

We have improved the reliability of pagination selection, allowing a robot to extract 50,000+ rows of data in one run.

What's Changed

• feat: latest compose changes for upgrade by @amhsirak in #325
• feat: dark theme support by @AmitChauhan63390 in #148
• feat: avoid virtual scroll in proxy info ui by @amhsirak in #326
• chore: add docs to readme by @amhsirak in #328
• feat: toggle mode tooltip by @amhsirak in #329
• feat: link docs to user menu by @amhsirak in #330
• feat: match toggle mode icon color in dark mode to theme by @amhsirak in #332
• feat(refactor): move away from atomic design pattern by @amhsirak in #333
• feat: add language option by @amhsirak in #301
• feat: routing by @amhsirak in #336
• feat: set output as default tab for run by @amhsirak in #337
• feat: redirect to robot integrate route after google oauth by @amhsirak in #338
• feat: limit output preview data to 5 by @RohitR311 in #334
• feat(ui): position robot settings modal by @ninja-programmer in #342
• feat: add message to display list being empty by @RohitR311 in #300
• feat: reset remote browser recording state by @RohitR311 in #314
• feat: much more reliable pagination by @RohitR311 in #331
• feat: link docs to restart menu by @amhsirak in #343
• feat: recorder save panel UI consistency by @amhsirak in #344
• chore: remove selector console logs by @amhsirak in #345
• chore: pre-release 0.0.7 by @amhsirak in #346
• feat: arm64 architecture support by @RohitR311 in #341
• feat: docker setup upgrade instructions by @amhsirak in #347

New Contributors

• @ninja-programmer made their first contribution in #342

Full Changelog: v0.0.6...v0.0.7

Maxun v0.0.6 | 50%+ reduction in memory usage, IFrame & Shadow DOM extraction

What's New

Better Extraction 🕷️

Support for iframes and shadow dom!

Recording Browser Optimization 🎉

1. Overall memory usage improved by ~1.56x (56% reduction in memory usage)
2. Massive improvements for External and Array Buffers (~90%+ reductions).
3. Heap memory usage reduced by ~1.3 GB, which is nearly 30% less memory usage for the heap!

What's Changed

• fix: browser window english language by @RohitR311 in #287
• fix: preserve previous labels steps before adding list step by @RohitR311 in #288
• chore: code cleanup by @amhsirak in #289
• fix: i18n logs by @amhsirak in #290
• feat: enhance edit robot ui by @amhsirak in #292
• chore: login translation switcher by @amhsirak in #293
• fix: move handleSave onClick to save button for edit robot by @amhsirak in #294
• fix: avoid reload on duplicate robot cancel by @amhsirak in #295
• chore: add refs in urls by @naveenpan09 in #297
• feat: better parsing of tables by @RohitR311 in #291
• feat: work email translations by @amhsirak in #298
• feat: add delete functionality for text and list steps by @RohitR311 in #299
• feat: navigate across capture list stages by @RohitR311 in #303
• feat: confirmation UI for pagination & limit steps by @amhsirak in #304
• fix: avoid ui shift on api key reveal by @amhsirak in #307
• chore: cleanup src/api by @amhsirak in #309
• fix: twitter typo by @amhsirak in #310
• feat: notify on schedule delete by @amhsirak in #308
• docs: update website to maxun.dev by @amhsirak in #312
• fix: translation changes by @RohitR311 in #316
• fix: update custom limit if value >= 1 by @RohitR311 in #315
• feat: shadow dom selection by @amhsirak in #296
• feat: support iframe extraction by @amhsirak in #275
• feat: compatibility check for shadowDOM and iframe scraping by @RohitR311 in #320
• feat: recorder performance improvements by @amhsirak in #313
• feat: handle selection for input & select tags by @amhsirak in #322

Full Changelog: v0.0.5...v0.0.6

Maxun v0.0.5 Release 🎉 | Input Handlers, Internationalization Support

Hey Everybody! v0.0.5 introduces input handlers and i18n support! 🎉

⚙️ Input Handlers Available

1. Date Fields
2. Dropdowns
3. Range
4. Time
5. Checkboxes
6. Radios

🔤 Internationalization Support (i18n)

1. English
2. Chinese
3. Japanese
4. German
5. Spanish

What's Changed

• chore: remove local note by @amhsirak in #251
• feat: remove fe be mounts by @amhsirak in #256
• feat: add check for selector visibility, revert domcontentloaded to networkidle state by @RohitR311 in #257
• fix: scrapeList empty output preview by @RohitR311 in #264
• feat: browser improvements by @amhsirak in #259
• feat: selection revamp by @amhsirak in #266
• fix: skip click action if selector not visible by @RohitR311 in #267
• feat: add functionality to handle user inputs (part 1) by @RohitR311 in #268
• feat: selection for <select> tag by @amhsirak in #272
• feat: selection for <input> tags by @amhsirak in #273
• feat: clearer upgrade instructions by @amhsirak in #274
• feat: handle datetime-local <input> tag by @amhsirak in #276
• feat: auto logout by @amhsirak in #277
• chore: format concurreny.ts in maxun-core by @richardzen in #280
• chore: cleanup some code by @richardzen in #279
• feat(.github): delete duplicate directory by @richardzen in #278
• Update README.md by @HCSS-StratBase in #258
• feat: internationalization (i18n) by @AmitChauhan63390 in #242
• feat: add output preview data reset functionality by @RohitR311 in #282
• feat: avoid crash due to adblocker by @amhsirak in #284
• chore: release v0.0.5 by @amhsirak in #261

New Contributors

• @richardzen made their first contribution in #280
• @HCSS-StratBase made their first contribution in #258

Full Changelog: v0.0.4...v0.0.5

Maxun v0.0.4 Release 🎉 | Extract Behind Login, Product Updates

Hey Everybody! v0.0.4 introduces two new features

Extract Behind Login

Introducing extract behind login in Maxun!🔐
With extract behind login, you can scrape data behind logins using username and password. Cookie sessions coming soon! 🍪
👉 Watch this video to know more: https://www.youtube.com/watch?v=_-n6OFQI_x4

Product Updates

Upgrading self-hosted open-source software is hard. To make it easier, we are bringing product upgrades. You will automatically be notified on your dashboard when a new release is available! ⚡

What's Changed

• fix: use window.location.origin as baseUrl for scrapeList by @amhsirak in #228
• feat: product updates by @amhsirak in #233
• feat: extract behind login by @RohitR311 in #229
• feat: rect dom depth information by @amhsirak in #235
• feat: apply conditional visual containment by @amhsirak in #238
• fix: include visual containment for capture list selection by @amhsirak in #241
• fix: handle context destroyed and frame navigation by @RohitR311 in #243
• feat: emit setGetList false socket event in pagination mode by @amhsirak in #244
• feat: conditional selection by @amhsirak in #246
• feat: node version in docker images by @amhsirak in #247
• fix: explicitly set easylist url by @amhsirak in #248
• feat: website to api improvements (swagger) by @amhsirak in #249
• chore: release v0.0.4 by @amhsirak in #225
• chore: use updated playwright image by @amhsirak in #250

Full Changelog: hotfix-0.0.3...v0.0.4

Maxun Hotfix Release | hotfix-0.0.3

The hotfix is for creating robots that require pagination. v0.0.3 accidentally broke it. Please upgrade to this release, else your robots with pagination will fail.

Steps To Upgrade Maxun Version

1. go to project directory
2. run git pull origin master
3. if using docker, perform step 1 & 2 then:

• run docker-compose down
• run docker-compose pull
• run docker-compose up -d

Full Changelog: v0.0.3...hotfix-0.0.3