- Overview
- Features
- Requirements
- Usage
- Output
- Logging
- Configuration
- Customization
- Troubleshooting
- Example Usage
- API Support
- API Usage Commands
- Personal Experience
- Email Verification Provider Comparison Costs
- Email Verification Provider API Speed & Rate Limits
- Email Verification Results Table Compare
- EmailListVerify
- EmailListVerify Bulk File API
- MillionVerifier
- MillionVerifier Bulk File API
- MillionVerifier Bulk API Differences
- CaptainVerify API
- Proofy API
- MyEmailVerifier API
- Zerobounce API,
- Reoon API
- Bouncify API
- Bounceless API
- API Merge
- Cloudflare HTTP Forward Proxy Cache With KV Storage
- PHP Wrapper
The validate_emails.py is a Python-based tool for email verification and email validation that allows you to classify your email addresses' status using syntax, DNS, and SMTP (Simple Mail Transfer Protocol) and other checks and 3rd party APIs. Using the script's returned status classifications, you can then clean or scrub your email lists. This can be done self-hosted locally on a server or via the supported commercial email verification service APIs (jump straight to email verification provider API speed and result benchmarks). The validate_emails.py script is coded to conditionally support each commercial email verification providers' API rate limits and can be tuned via argument -wf work factor to adjust the number of concurrent threads used for single email address API requests. This ensures you do not waste time and credit $$$$ running into API rate limits.
The script's API Merge support also allows you to combine 2 API email verification providers results into one JSON formated output for double verification checks. The script provides a convenient way to verify the existence and deliverability of email addresses, helping you maintain a clean and accurate email list.
The script offers specific support for Xenforo forum member email list verification through dedicated Xenforo argument flags. These flags enable you to mark invalid Xenforo forum member emails and move them to a bounce_email status, effectively disabling Xenforo email sending to those members without actually deleting the Xenforo member account. You can then setup a Xenforo forum wide notice targetting bounce_email status users - prompting them to update their email addresses.
To reduce potential 3rd party email verification API costs, this script also supports Cloudflare HTTP Forward Proxy Cache With KV Storage for both per email check and bulk file API check results to be temporarily cached and return the email verification status codes at the Cloudflare CDN and Cloudflare Worker KV storage level.
Email verification results can also be optionally saved to Amazon AWS S3 and Cloudflare R2 object storage for long term storage and retrieval.
The validate_emails.py email validation script was written by George Liu (eva2000) for his paid consulting clients usage. The below is public documentation for the script.
- Validates email addresses using syntax, DNS and SMTP checks
- Validates
-ffrom email address's SPF, DKIM, DMARC records and logs them for troubleshooting mail deliverability - Optionally save your email verification results to S3 object storage providers - Cloudflare R2 or Amazon S3
- Support local self-hosted email verification + API support for:
- EmailListVerify [example, bulk API]
- MillionVerifier [example, bulk API]
- MyEmailVerifier [example]
- CaptainVerify [example]
- Proofy.io [example]
- Zerobounce [example]
- Reoon [example]
- Bouncify [example]
- Bounceless [example]
- API Merge support via
-apimergeargument to merge EmailListVerify + MillionVerifier API results together for more accurate email verification results.
- Supports Cloudflare HTTP Forward Proxy Cache With KV Storage for EmailListVerify per email check API
- Classifies email addresses into various categories based on the syntax, DNS, and SMTP response
- Supports concurrent processing for faster validation of multiple email addresses
- Provides detailed logging for tracking the validation process
- Allows customization of delay between requests to respect email server limitations
- Supports input of email addresses via command-line arguments or a file
- Identifies disposable email addresses and free domain name provider addresses
- Checks email addresses against custom blacklists and whitelists
- Supports different test modes for syntax, DNS, SMTP, and disposable email checks
- Configurable SMTP port and TLS/SSL support
- Supports SMTP profiles. However, using SMTP relay profiles won't get accurate SMTP checks. Locally ran server SMTP checks are more accurate.
- Supports different DNS lookup methods: asyncio, concurrent, and sequential
- Supports different processing modes: thread and asyncio
- Xenforo support. Generates SQL queries for updating user status
user_statein XenForo forum based email validation results. Allowing you to clean up your Xenforo user database's email addresses by disabling email sending to those specific bad email addresses.
- Python 3.6 minimum. Script tested on AlmaLinux 8 Python 3.6 and AlmaLinux 9 Python 3.9.
-
Open a terminal or command prompt and navigate to the directory where the script is located.
-
Run the script with the desired command-line arguments.
python validate_emails.py
usage: validate_emails.py [-h] -f FROM_EMAIL [-e EMAILS] [-l LIST_FILE] [-b BATCH_SIZE] [-d] [-v] [-delay DELAY] [--cache-timeout CACHE_TIMEOUT]
[-t TIMEOUT] [-r RETRIES] [-tm {syntax,dns,smtp,all,disposable}] [-dns {asyncio,concurrent,sequential}]
[-p {thread,asyncio}] [-bl BLACKLIST_FILE] [-wl WHITELIST_FILE] [-smtp {default,ses,generic,rotate}] [-xf]
[-xfdb XF_DATABASE] [-xfprefix XF_PREFIX] [-profile] [-wf WORKER_FACTOR]
[-api {emaillistverify,millionverifier,captainverify,proofy,myemailverifier,zerobounce,reoon,bouncify,bounceless}]
[-apikey EMAILLISTVERIFY_API_KEY] [-apikey_mv MILLIONVERIFIER_API_KEY]
[-apibulk {emaillistverify,millionverifier,proofy,bounceless}] [-apikey_cv CAPTAINVERIFY_API_KEY]
[-apikey_pf PROOFY_API_KEY] [-apiuser_pf PROOFY_USER_ID] [-pf_max_connections PROOFY_MAX_CONNECTIONS]
[-pf_batchsize PROOFY_BATCH_SIZE] [-apikey_mev MYEMAILVERIFIER_API_KEY] [-apikey_zb ZEROBOUNCE_API_KEY]
[-apikey_rn REOON_API_KEY] [-reoon_mode {quick,power}] [-reoon_max_connections REOON_MAX_CONNECTIONS]
[-apikey_bf BOUNCIFY_API_KEY] [-apikey_bl BOUNCELESS_API_KEY] [-mev_max_connections MEV_MAX_CONNECTIONS] [-apimerge]
[-apicache {emaillistverify,zerobounce,millionverifier}] [-apicachettl APICACHETTL]
[-apicachecheck {count,list,purge}] [-apicache-purge] [-store {r2,s3}] [-store-list]
validate_emails.py: error: the following arguments are required: -f/--from_email
The available arguments are:
-f,--from_email(required):- Description: The email address to use in the MAIL FROM command.
-e,--emails(optional):- Description: A single email or comma-separated list of emails to check.
-l,--list_file(optional):- Description: The path to a file containing emails, one per line.
-b,--batch_size(optional):- Description: The number of concurrent processes to use (default is 1).
-d,--debug(optional):- Description: Enable debug logging for more verbose output.
-v,--verbose(optional):- Description: Enable verbose output.
-delay,--delay(optional):- Description: The delay between requests in seconds (default is 1).
--cache-timeout(optional):- Description: Set the caching resolver timeout value (default is 14400).
-t,--timeout(optional):- Description: The timeout in seconds for SMTP connection and commands (default is 10).
-r,--retries(optional):- Description: The number of retries for temporary failures and timeouts (default is 3).
-tm,--test-mode(optional):- Description: The test mode to use for email validation. Available options are:
syntax: Check email format syntax only.dns: Perform DNS validation only (default).smtp: Perform SMTP validation only.all: Perform all validations.disposable: Check if the email is from a disposable domain.
- Description: The test mode to use for email validation. Available options are:
-dns,--dns-method(optional):- Description: The DNS lookup method to use. Available options are:
asyncio: Use asynchronous DNS lookups using the asyncio library (default).concurrent: Use concurrent DNS lookups using the concurrent.futures library.sequential: Use basic sequential DNS lookups.
- Description: The DNS lookup method to use. Available options are:
-p,--process_mode(optional):- Description: The processing mode to use for the
process_emailsfunction. Available options are:thread: Use thread-based processing (default).asyncio: Use asyncio-based processing.
- Description: The processing mode to use for the
-bl,--blacklist_file(optional):- Description: The path to a file containing blacklisted domains, one per line.
-wl,--whitelist_file(optional):- Description: The path to a file containing whitelisted domains, one per line.
-smtp,--smtp_profile(optional):- Description: The SMTP profile to use for email validation. Available options are:
default: Use the default SMTP settings (default).ses: Use Amazon SES SMTP settings viases.iniconfig file.generic: Use generic SMTP settings viasmtp.iniconfig file.rotate: Use multiple SMTP profile settings viarotate.iniconfig file which you can rotate through.
- Description: The SMTP profile to use for email validation. Available options are:
-xf,--xf_sql(optional):- Description: Generate SQL queries for updating
user_statein XenForo for emails with specific statuses.
- Description: Generate SQL queries for updating
-xfdb,--xf_database(optional):- Description: The XenForo database name (default is 'DATABNAME').
-xfprefix,--xf_prefix(optional):- Description: The XenForo table prefix (default is 'xf_').
-profile,--profile(optional):- Description: Enable profiling of the script.
-wf,--worker-factor(optional):- Description: The worker factor for calculating the maximum number of worker threads (default is 16).
-api,--api(optional):- Description: Specify the API to use for email verification. Available options are:
emaillistverify: Use the EmailListVerify API.millionverifier: Use the MillionVerifier API.myemailverifier: Use the MyEmailVerifier API.captainverify: Use the CaptainVerify API.proofy: Use the Proofy API.zerobounce: Use the Zerobounce.net API.reoon: Use the Zerobounce.net API.bouncify: Use the Bouncify API.bounceless: Use the Bounceless API.
- Description: Specify the API to use for email verification. Available options are:
-apimerge,--api_merge(optional):- Description: Merge and combine
emaillistverifyormillionverifierAPI results into one result
- Description: Merge and combine
-apibulk,--api_bulk(optional):- Description: Use
emaillistverifyormillionverifiervalues for Bulk file API method.
- Description: Use
-apikey,--emaillistverify_api_key(optional):- Description: The API key for the EmailListVerify service.
-apikey_mv,--millionverifier_api_key(optional):- Description: The API key for the MillionVerifier service.
-apikey_mev,--myemailverifier-api-key(optional):- Description: The API key for the MyEmailVerifier service.
-apikey_cv,--captainverify_api_key(optional):- Description: The API key for the CaptainVerify service.
-apikey_zb,--zerobounce_api_key(optional):- Description: The API key for the Zerobounce.net service.
-apikey_rn,--reoon_api_key(optional):- Description: The API key for the Reoon service.
-reoon_mode,--reoon_mode- Description: Reoon verification mode
quickorpower
- Description: Reoon verification mode
-apikey_bf,--bouncify_api_key- Description: The API key for the Bouncify service.
-apikey_bl,--bounceless_api_key- Description: The API key for the Bounceless service.
-apikey_pf,--proofy_api_key(optional):- Description: The API key for the Proofy service.
-apiuser_pf,--proofy_user_id(optional):- Description: The Proofy userid.
-pf_max_connections(optional):- Description: Maximum number of concurrent connections for the Proofy.io API (default: 1)
-mev_max_connections(optional):- Description: Maximum number of concurrent connections for the MyEmailVerifier API (default: 1)
-reoon_max_connections(optional):- Description: Maximum number of concurrent connections for the Reoon API (default: 5)
-apicache,--api_cache(optional):- Description: Set the appropriate API's Cloudflare Worker KV cacheKey prefix. Available options are:
emaillistverify: Use with the EmailListVerify API.zerobounce: Use with the ZeroBounce API.millionverifier: Use with the MillionVerifier API.
- Description: Set the appropriate API's Cloudflare Worker KV cacheKey prefix. Available options are:
-apicachettl(optional):- Description: this sets the cache TTL duration in seconds for how long Cloudflare CDN/KV stores in cache (default: 300 seconds)
-apicachecheck(optional):- Description: operates when
-apicachettlis set and takescountorlistorpurgeoptions to query the Cloudflare KV storage cache to count number of cached entries or list the entries themselves
- Description: operates when
-apicache-purge(optional):- Description: purges Cloudflare CDN/KV cache when
-apicachecheckset topurgeoption
- Description: purges Cloudflare CDN/KV cache when
Validates -f from email address's SPF, DKIM, DMARC records when argument is passed and logs them
python validate_emails.py -f user@domain1.com
cat email_verification_log_2024-05-05_01-54-51.log
2024-05-05 01:54:51,105 - INFO - SPF record found for user@domain1.com
2024-05-05 01:54:51,105 - INFO - SPF record: "v=spf1 include:_spf.google.com +a +mx ~all"
2024-05-05 01:54:51,142 - ERROR - Error checking DKIM for user@domain1.com with selector default: The DNS response does not contain an answer to the question: default._domainkey.domain1.com. IN TXT
2024-05-05 01:54:51,174 - INFO - DKIM record found for user@domain1.com with selector google
2024-05-05 01:54:51,174 - INFO - DKIM record: "v=DKIM1; k=rsa; p=MIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQCMF3nm2Za6EN0udFQLb35Jcy3u63iCzdaojAkVsCISJsHKe2ThgSsriU1MRm32abcd/u2aNEAxJ3jhN7TbkuV8j7xppV5PW+abcd/84lxa2xTlngXOymlJWleoTZUQQPkmkB66IO/XqZVj7RrF/Iru1qpAvJ9aW+6vCZEJFjCZowIDAQAB"
2024-05-05 01:54:51,237 - WARNING - Error checking DMARC for user@domain1.com with record name _dmarc: The DMARC record must be located at _dmarc._dmarc.domain1.com, not _dmarc.domain1.com
2024-05-05 01:54:51,562 - INFO - DMARC record found for user@domain1.com with record name _dmarc.mail
2024-05-05 01:54:51,562 - INFO - DMARC record: v=DMARC1; p=quarantine; sp=none; rua=mailto:re+xxx@inbound.dmarcdigests.com,mailto:re+yyy@dmarc.postmarkapp.com; aspf=r; pct=100
2024-05-05 01:54:51,562 - INFO - DMARC policy check passed for user@domain1.com
Example usage for DNS only checks (skipping SMTP checks):
python validate_email.py -f sender@example.com -e user1@example.com,user2@example.com -tm dns
Example usage for DNS + SMTP checks:
python validate_email.py -f sender@example.com -e user1@example.com,user2@example.com -tm all
Notes:
- If the
-tmflag is not passed, it defaults to DNS test mode only. - Tuning
-wfworker factor value for calculating the maximum number of worker threads can speed up the processing of emails when in-p threadprocess mode or when no-pflag is set. Example benchmark of 10,000 email addresses for-tm dns -p threadfor DNS only tests (using default-dns asyncio) using process method = thread took 4mins 40s to complete with work factor-wf 4. However, with-wf 80time to completion took ~40s on a Intel Core i7 4790K 4C/8T or ~33s on a Intel Xeon E-2276G 6C/12T based dedicated server.
The script outputs the validation results in JSON format. Each email address is represented by an object with the following fields:
email: The email address.status: The validation status of the email address. Possible values are:valid_format: The email address has a valid format.invalid: The email address has an invalid format.valid_dns: The email address has valid DNS records.invalid_dns: The email address has invalid DNS records.ok: The email address passed SMTP validation.unknown_email: The email address is unknown or doesn't exist.temporary_failure: A temporary failure occurred during SMTP validation.syntax_or_command_error: An SMTP syntax or command error occurred.transaction_failed: The SMTP transaction failed.timeout: A timeout occurred during SMTP validation.skipped_smtp_check: SMTP validation was skipped based on the test mode.
status_code: SMTP validation check's logged SMTP response code.free_email: Indicates whether the email address is from a free email provider. Possible values areyes,no, orunknown.disposable_email: Indicates whether the email address is from a disposable domain. Possible values areyes,no, ornotchecked.xf_sql(optional): The SQL query for updating the user status in XenForo based on the validation result.
The script generates a log file named email_verification_log_<timestamp>.log in the same directory as the script. The log file contains detailed information about the validation process, including any errors or warnings encountered.
If -v verbose mode is used with -tm all for SMTP domain MX record checks, an additional debug log file named email_verification_log_debug_<timestamp>.log is generated in the same directory as the script. The debug log has extended logging of the SMTP responses.
Add validate_emails.ini config file support so Cloudflare Worker KV caching endpoint url can be defined outside of the script. If validate_emails.ini doesn't exist, you'll get this message
./validate_emails.py
Error: 'api_url' setting not found in 'validate_emails.ini' file.
Please create the 'validate_emails.ini' file in the same directory as the script and add the 'api_url' setting.
validate_emails.ini contents setting api_url
[settings]
api_url=http=https://your_cf_worker.com
Commercial email verification providers usually only store your file based uploaded or bulk file API uploaded files for a defined duration i.e. 15 to 30 days before they are deleted. And per email check API results are usually not stored at all. So if you need to store your per email check or bulk file API email verification results for longer, the validate_emails.py script now supports saving your results to S3 object storage providers - Cloudflare R2 or Amazon AWS S3. Saving such email verification result logs might be usual for historic comparisons and checks. According to ZeroBounce, on average an email list decays by an average of 25.74% yearly with the leading causes of bounced emails being invalid email addresses and catch-all email addresses.
Add optional Cloudflare R2 S3 object storage or Amazon AWS S3 object storage which will allow you to save your validate_emails.py ran JSON output in externel Cloudflare R2 or Amazon AWS S3 object storage buckets via validate_emails.ini defined:
For Cloudflare R2
[r2]
endpoint_url = https://your-account-id.r2.cloudflarestorage.com
aws_access_key_id = your-r2-access-key-id
aws_secret_access_key = your-r2-secret-access-key
bucket_name = your-r2-bucket-name
For Amazon AWS S3
[s3]
endpoint_url = https://your-s3-endpoint-url
aws_access_key_id = your-s3-access-key-id
aws_secret_access_key = your-s3-secret-access-key
bucket_name = your-s3-bucket-name
Below example to send validate_emails.py script results to Cloudflare R2 S3 object storage via -store r2 argument. Using EmailListVerify per email check API -api emaillistverify -apikey $elvkey + Cloudflare cached for 120 seconds -apicache emaillistverify -apicachettl 120
time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com,hnyfmw2@canadlan-drugs.com,hnyfmw3@canadlan-drugs.com -api emaillistverify -apikey $elvkey -apicache emaillistverify -apicachettl 120 -tm all -store r2
Output stored successfully in R2: emailapi-emaillistverify-cached/output_20240511051940.json
[
{
"email": "hnyfmw@canadlan-drugs.com",
"status": "unknown",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "hnyfmw2@canadlan-drugs.com",
"status": "unknown",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "hnyfmw3@canadlan-drugs.com",
"status": "unknown",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
}
]
real 0m1.663s
user 0m0.391s
sys 0m0.039s
validate_emails.py script's Cloudflare R2 saved emailapi-emaillistverify-cached/output_20240511051940.json log contents
cat emailapi-emaillistverify-cached/output_20240511051940.json
[{"email": "hnyfmw@canadlan-drugs.com", "status": "unknown", "status_code": null, "free_email": "no", "disposable_email": "no"}, {"email": "hnyfmw2@canadlan-drugs.com", "status": "unknown", "status_code": null, "free_email": "no", "disposable_email": "no"}, {"email": "hnyfmw3@canadlan-drugs.com", "status": "unknown", "status_code": null, "free_email": "no", "disposable_email": "no"}]
validate_emails.py run log inspection
cat $(ls -Art | tail -3 | grep 'email_verification')
2024-05-11 05:14:23,074 - INFO - Checking cache for email: hnyfmw@canadlan-drugs.com
2024-05-11 05:14:23,075 - INFO - Checking cache for email: hnyfmw2@canadlan-drugs.com
2024-05-11 05:14:23,075 - INFO - Checking cache for email: hnyfmw3@canadlan-drugs.com
2024-05-11 05:14:25,206 - INFO - Cache result: unknown
2024-05-11 05:14:25,966 - INFO - Cache result: unknown
2024-05-11 05:14:26,092 - INFO - Cache result: unknown
Non-cached EmailListVerify per email check API -api emaillistverify -apikey $elvkey run
time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com,hnyfmw2@canadlan-drugs.com,hnyfmw3@canadlan-drugs.com -api emaillistverify -apikey $elvkey -tm all -store r2
Output stored successfully in R2: emailapi-emaillistverify/output_20240511055822.json
[
{
"email": "hnyfmw@canadlan-drugs.com",
"status": "unknown",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "hnyfmw2@canadlan-drugs.com",
"status": "unknown",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "hnyfmw3@canadlan-drugs.com",
"status": "unknown",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
}
]
real 0m10.612s
user 0m0.541s
sys 0m0.033s
validate_emails.py script's Cloudflare R2 saved emailapi-emaillistverify/output_20240511055822.json log contents
cat emailapi-emaillistverify/output_20240511055822.json
[{"email": "hnyfmw@canadlan-drugs.com", "status": "unknown", "status_code": null, "free_email": "no", "disposable_email": "no"}, {"email": "hnyfmw2@canadlan-drugs.com", "status": "unknown", "status_code": null, "free_email": "no", "disposable_email": "no"}, {"email": "hnyfmw3@canadlan-drugs.com", "status": "unknown", "status_code": null, "free_email": "no", "disposable_email": "no"}]
The script supports loading SMTP settings from a configuration file named ses.ini. The file should have the following format:
[ses]
server = your_ses_smtp_server
port = your_ses_smtp_port
use_tls = True
username = your_ses_username
password = your_ses_password
If the ses SMTP profile is specified using the -smtp ses argument, the script will load the SMTP settings from the ses.ini file.
However, using SMTP relay profiles won't get accurate SMTP checks. Locally ran server SMTP checks are more accurate.
The rotate.ini file is used to store multiple SMTP profiles that can be rotated during the email verification process with -smtp rotate argument is passed on command line. Each profile represents a different SMTP server configuration.
Here's an example of how the rotate.ini file can be populated:
[profile1]
server = smtp1.example.com
port = 587
use_tls = yes
username = user1@example.com
password = password1
[profile2]
server = smtp2.example.com
port = 465
use_tls = yes
username = user2@example.com
password = password2
[profile3]
server = smtp3.example.com
port = 25
use_tls = no
username = user3@example.com
password = password3In this example, the rotate.ini file contains three SMTP profiles: profile1, profile2, and profile3. Each profile is defined as a separate section in the INI file.
The properties for each profile are:
server: The hostname or IP address of the SMTP server.port: The port number to use for the SMTP connection (e.g., 25, 465, 587).use_tls: Indicates whether to use TLS encryption for the SMTP connection. Set toyesorno.username: The username for SMTP authentication.password: The password for SMTP authentication.
You can add as many profiles as needed to the rotate.ini file, each with its own unique section name and SMTP server settings.
When the rotate profile is selected using the -smtp rotate option, the script will randomly choose one of the profiles defined in rotate.ini for each email verification request. This allows for distributing the email verification load across multiple SMTP servers.
Make sure to populate the rotate.ini file with the appropriate SMTP server settings for each profile before using the rotate profile option.
However, using SMTP relay profiles won't get accurate SMTP checks. Locally ran server SMTP checks are more accurate.
The smtp.ini file is used to store the configuration for a single generic SMTP server that can be used for email verification with -smtp generic argument is passed on command line.
Here's an example of how the smtp.ini file can be populated:
[generic]
server = smtp.example.com
port = 587
use_tls = yes
username = user@example.com
password = passwordIn this example, the smtp.ini file contains a single section named [generic], which represents the generic SMTP profile.
The properties for the generic profile are:
server: The hostname or IP address of the SMTP server.port: The port number to use for the SMTP connection (e.g., 25, 465, 587).use_tls: Indicates whether to use TLS encryption for the SMTP connection. Set toyesorno.username: The username for SMTP authentication.password: The password for SMTP authentication.
When the generic profile is selected using the -smtp generic option, the script will use the SMTP server settings defined in the smtp.ini file for all email verification requests.
Make sure to populate the smtp.ini file with the appropriate SMTP server settings before using the generic profile option.
However, using SMTP relay profiles won't get accurate SMTP checks. Locally ran server SMTP checks are more accurate.
You can customize the behavior of the script by modifying the following variables in the code:
DEFAULT_DELAY: The default delay between requests in seconds (default is 1).LARGE_PROVIDER_DELAY: The delay for large email providers in seconds (default is 2).LARGE_PROVIDERS: A list of large email providers that require a longer delay between requests.
If you encounter any issues or errors while running the script, consider the following:
- Ensure that you have installed all the required Python packages.
- Check the log file for detailed error messages and traceback information.
- Verify that the email addresses provided are valid and properly formatted.
- Make sure you have a stable internet connection for accurate DNS and SMTP validations.
- If you are using custom blacklist or whitelist files, ensure that they exist and contain valid domain entries.
-
The
smtp_checkfunction now accepts adomain_responsesparameter, which is a dictionary to store the SMTP responses for each domain. It records the SMTP response code and message for each domain. -
The
process_emailsfunction creates adomain_responsesdictionary to store the SMTP responses per domain. It passes this dictionary to thevalidate_and_classifyfunction. -
After processing the emails, the
process_emailsfunction analyzes the SMTP responses for each domain. It calculates the failure rate based on the SMTP response codes. If the failure rate exceeds a predefined threshold (e.g., 5% in this example), it logs a warning message indicating that the verification strategy needs to be adjusted for that domain. -
The
validate_and_classifyfunction now accepts thedomain_responsesparameter and passes it to thesmtp_checkfunction.
With these changes, the script will proactively monitor SMTP responses and adjust the verification strategy based on the feedback from the servers.
Example in log
grep failure email_verification_log_2024-05-03_08-45-05.log
2024-05-03 08:45:07,910 - INFO - Acceptable failure rate (0.00%) for domain gmail.com.
AWS SES SMTP support and Xenforo support to display MySQL query for bad emails only to set their status to email_bounce passing flags -xf and -xfdb xenforo and -xfprefix xf_
python validate_emails.py -f user@domain1.com -l emaillist.txt -smtp ses -xf -xfdb xenforo -xfprefix xf_
ses.ini
[ses]
server = email-smtp.us-west-2.amazonaws.com
port = 587
use_tls = true
username = YOUR_AWS_SES_SMTP_USERNAME
password = YOUR_AWS_SES_SMTP_PASSWORD
Xenforo support to display MySQL query for bad emails only to set their status to email_bounce passing flags -xf and -xfdb xenforo and -xfprefix xf_ with disposable_email status field
Xenforo arguments mode for -xf -xfdb xenforo -xfprefix xf_ has ben updated to output
xf_sqlfor MySQL query you can run on SSH command line. The command's double quotes are escaped\"so you remove the backslash manually, or use below outlinedjqtool to automatically remove itxf_sql_batchfor MySQL query run in MySQL client, phpmyadmin etcxf_sql_userfor MySQL query you can run on SSH command line to look up Xenforo user details for that email address. The command's double quotes are escaped\"so you remove the backslash manually, or use below outlinedjqtool to automatically remove it
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -xf -xfdb xenforo -xfprefix xf_
[
{
"email": "user@mailsac.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "yes",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';\" xenforo",
"xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';",
"xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'user@mailsac.com'\\G\" xenforo"
},
{
"email": "xyz@centmil1.com",
"status": "invalid",
"status_code": null,
"free_email": "unknown",
"disposable_email": "no"
},
{
"email": "user+to@domain1.com",
"status": "ok",
"status_code": 250,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "xyz@domain1.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';\" xenforo",
"xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';",
"xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'xyz@domain1.com'\\G\" xenforo"
},
{
"email": "abc@domain1.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';\" xenforo",
"xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';",
"xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'abc@domain1.com'\\G\" xenforo"
},
{
"email": "123@domain1.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';\" xenforo",
"xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';",
"xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '123@domain1.com'\\G\" xenforo"
},
{
"email": "pop@domain1.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';\" xenforo",
"xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';",
"xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'pop@domain1.com'\\G\" xenforo"
},
{
"email": "pip@domain1.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';\" xenforo",
"xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';",
"xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'pip@domain1.com'\\G\" xenforo"
},
{
"email": "user@tempr.email",
"status": "ok",
"status_code": 250,
"free_email": "no",
"disposable_email": "yes",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';\" xenforo",
"xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';",
"xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'user@tempr.email'\\G\" xenforo"
},
{
"email": "info@domain2.com",
"status": "ok",
"status_code": 250,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@gmail.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "op999@gmail.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "yes",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';\" xenforo",
"xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';",
"xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'op999@gmail.com'\\G\" xenforo"
},
{
"email": "user@yahoo.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user1@outlook.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user2@hotmail.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "no"
}
]
Use jq tool to filter for xf_sql only
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -xf -xfdb xenforo -xfprefix xf_ | jq -r '.[] | select(.xf_sql) | .xf_sql'
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';" xenforo
Use jq tool to filter for xf_sql_batch only. You can pipe or place this output into a update.sql file and import into your Xenforo MySQL database to batch update the user's user_state
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -xf -xfdb xenforo -xfprefix xf_ | jq -r '.[] | select(.xf_sql_batch) | .xf_sql_batch'
UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';
UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';
UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';
UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';
UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';
UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';
UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';
UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';
Use jq tool to filter for xf_sql_user only. This allows you to run on SSH command line the Xenforo database lookup for the Xenforo user details for the specific email address
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -xf -xfdb xenforo -xfprefix xf_ | jq -r '.[] | select(.xf_sql_user) | .xf_sql_user'
mysql -e "SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'user@mailsac.com'\G" xenforo
mysql -e "SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'xyz@domain1.com'\G" xenforo
mysql -e "SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'abc@domain1.com'\G" xenforo
mysql -e "SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '123@domain1.com'\G" xenforo
mysql -e "SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'pop@domain1.com'\G" xenforo
mysql -e "SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'pip@domain1.com'\G" xenforo
mysql -e "SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'user@tempr.email'\G" xenforo
mysql -e "SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'op999@gmail.com'\G" xenforo
Example running one of these commands for pop@domain1.com on server where Xenforo is installed. The user_state would either be valid prior to running above UPDATE command or email_bounce after running UPDATE command.
mysql -e "SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'pop@domain1.com'\G" xenforo
*************************** 1. row ***************************
user_id: 11
username: pop
email: pop@domain1.com
user_group_id: 2
secondary_group_ids: 3,4,6,8
message_count: 191817
register_date: 1400868747
last_activity: 1715011284
user_state: email_bounce
is_moderator: 1
is_admin: 1
is_banned: 0
register_date date
date -d @1400868747
Fri May 23 18:12:27 UTC 2014
last_activity date
date -d @1715011284
Mon May 6 16:01:24 UTC 2024
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -xf -xfdb xenforo -xfprefix xf_ | jq 'map({ status: .status }) | group_by(.status) | map({ status: .[0].status, count: length })'
[
{
"status": "invalid",
"count": 1
},
{
"status": "ok",
"count": 8
},
{
"status": "unknown_email",
"count": 6
}
]
Example lookup for Xenforo forum's email bounce log via my custom xf_bounce_log.py for email address hnyfmw@canadlan-drugs.com that is bouncing emails. And using validate_emails.py script's local and API to lookup email address status.
./xf_bounce_log.py -d $xfdb -n 10 -s desc | jq '.[] | select(.recipient == "hnyfmw@canadlan-drugs.com") | {bounce_id, message_type, action_taken, user_id, recipient, status_code, diagnostic_info, "Delivered-To": .raw_message["Delivered-To:"], "Delivery-date": .raw_message["Delivery-date:"], "Delivery-date": .raw_message["Delivery-date:"], "Subject": .raw_message["Subject:"]}'
{
"bounce_id": 203,
"message_type": "bounce",
"action_taken": "soft",
"user_id": 122136,
"recipient": "hnyfmw@canadlan-drugs.com",
"status_code": "4.4.7",
"diagnostic_info": " 550 4.4.7 Message expired: unable to deliver in 840 minutes.<421 4.4.0 Unable to lookup DNS for canadlan-drugs.com>",
"Delivered-To": "bouncer@domain1.com",
"Delivery-date": "Fri, 26 Apr 2024 15:44:06 +0000",
"Subject": "Delivery Status Notification (Failure)"
}
validate_emails.py self-hosted local email verification check for syntax, DNS and SMTP checks for hnyfmw@canadlan-drugs.com
time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all
[
{
"email": "hnyfmw@canadlan-drugs.com",
"status": "invalid",
"status_code": null,
"free_email": "unknown",
"disposable_email": "no"
}
]
real 0m0.932s
user 0m0.428s
sys 0m0.025s
validate_emails.py using external EmailListVerify API email verification check
time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api emaillistverify -apikey $elvkey
[
{
"email": "hnyfmw@canadlan-drugs.com",
"status": "unknown",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
}
]
real 0m2.626s
user 0m0.461s
sys 0m0.023s
validate_emails.py using external MillionVerifier API email verification check
time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api millionverifier -apikey_mv $mvkey
[
{
"email": "hnyfmw@canadlan-drugs.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": false,
"role_api": false
}
]
real 0m1.142s
user 0m0.455s
sys 0m0.024s
validate_emails.py using external MyEmailVerifier API email verification check
time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api myemailverifier -apikey_mev $mevkey
[
{
"email": "hnyfmw@canadlan-drugs.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
}
]
real 0m1.823s
user 0m0.463s
sys 0m0.019s
validate_emails.py using external CaptainVerify API email verification check
time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api captainverify -apikey_cv $cvkey
[
{
"email": "hnyfmw@canadlan-drugs.com",
"status": "unknown",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
}
]
real 0m25.264s
user 0m0.457s
sys 0m0.022s
Unfortunately, I ran out of credits to test with Proofy.io.
validate_emails.py using external Zerobounce API enabled run -api zerobounce -apikey_zb $zbkey -tm all with specified email address -e hnyfmw@canadlan-drugs.com. The status, sub_status and free_email_api JSON fields are from API and free_email and disposable_email JSON fields are from local script database checks.
python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api zerobounce -apikey_zb $zbkey -tm all
[
{
"email": "hnyfmw@canadlan-drugs.com",
"status": "invalid",
"sub_status": "no_dns_entries",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no"
}
]
validate_emails.py using external Reoon API enabled run -api reoon -apikey_rn $reokey -tm all with specified email address -e hnyfmw@canadlan-drugs.com. The status, role_account, mx_accepts_mail, spamtrap, mx_records, overall_score, safe_to_send, can_connect_smtp, inbox_full, catch_all, deliverable, disabled JSON field is from API and free_email and disposable_email JSON fields are from local script database checks.
Reoon has 2 modes for single email verification API which can be set via -reoon_mode to a value of either quick or power. The default mode without -reoon_mode being set is quick.
time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api reoon -apikey_rn $reokey
[
{
"email": "hnyfmw@canadlan-drugs.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "yes",
"role_account": "no",
"mx_accepts_mail": "no",
"spamtrap": "no",
"mx_records": null,
"verification_mode": "quick",
"overall_score": null,
"safe_to_send": null,
"can_connect_smtp": null,
"inbox_full": null,
"catch_all": null,
"deliverable": null,
"disabled": null
}
]
real 0m3.748s
user 0m0.358s
sys 0m0.028s
validate_emails.py using external Bouncify API enabled run -api bouncify -apikey_bf $bfkey -tm all with specified email address -e hnyfmw@canadlan-drugs.com. The status, free_email_api, disposable_email_api, role_api, and spamtrap_api JSON field are from API and free_email and disposable_email JSON fields are from local script database checks.
time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api bouncify -apikey_bf $bfkey
[
{
"email": "hnyfmw@canadlan-drugs.com",
"status": "undeliverable",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no",
"disposable_email_api": "no",
"role_api": "no",
"spamtrap_api": "no"
}
]
real 0m7.900s
user 0m0.357s
sys 0m0.030s
Here's a comparison using a commercial paid service EmailListVerify for the same emaillist.txt tested above. You can sign up using my affiliate link for EmailListVerify and free accounts get 100 free email verifications for starters.
disposable,"user@mailsac.com"
dead_server,"xyz@centmil1.com"
ok,"user+to@domain1.com"
disposable,"user@tempr.email"
ok,"info@domain2.com"
email_disabled,"xyz@domain1.com"
email_disabled,"abc@domain1.com"
email_disabled,"123@domain1.com"
email_disabled,"pop@domain1.com"
email_disabled,"pip@domain1.com"
ok,"user@gmail.com"
email_disabled,"op999@gmail.com"
ok,"user@yahoo.com"
ok,"user1@outlook.com"
ok,"user2@hotmail.com"
Where EmailListVerify status codes are as follows:
okAll is OK. The server is saying that it is ready to receive a letter to,this address, and no tricks have been detectederrorThe server is saying that delivery failed, but no information about,the email existssmtp_errorThe SMTP answer from the server is invalid or the destination server,reported an internal error to ussmtp_protocolThe destination server allowed us to connect but the SMTP,session was closed before the email was verifiedunknown_emailThe server said that the delivery failed and that the email address does,not existattempt_rejectedThe delivery failed; the reason is similar to “rejected”relay_errorThe delivery failed because a relaying problem took placeantispam_systemSome anti-spam technology is blocking the,verification progressemail_disabledThe email account is suspended, disabled, or limited and can not,receive emailsdomain_errorThe email server for the whole domain is not installed or is,incorrect, so no emails are deliverableok_for_allThe email server is saying that it is ready to accept letters,to any email addressdead_serverThe email server is dead, and no connection to it could be establishedsyntax_errorThere is a syntax error in the email addressunknownThe email delivery failed, but no reason was givenaccept_allThe server is set to accept all emails at a specific domain.,These domains accept any email you send to themdisposableThe email is a temporary address to receive letters and expires,after certain time periodspamtrapThe email address is maintained by an ISP or a third party,which neither clicks nor opens emailsinvalid_mxAn undocumentated status value that isn't in their documentation. As the name implies, invalid MX DNS records
Filter for disposable_email = yes
python validate_emails.py -f user@domain1.com -l emaillist.txt -xf -xfdb xenforo -xfprefix xf_ -tm all | jq '.[] | select(.disposable_email == "yes")'
{
"email": "user@mailsac.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "yes"
}
{
"email": "user@tempr.email",
"status": "ok",
"status_code": 250,
"free_email": "no",
"disposable_email": "yes"
}
Using jq tool to only list MySQL queries for bad emails only
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -xf -xfdb xenforo -xfprefix xf_ | jq -r '.[] | select(.xf_sql) | .xf_sql'
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';" xenforo
Filter using jq tool for free_email = yes emails only
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all | jq '.[] | select(.free_email == "yes")'
{
"email": "user@mailsac.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "yes"
}
{
"email": "user@gmail.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "no"
}
{
"email": "op999@gmail.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "yes",
"disposable_email": "no"
}
{
"email": "user@yahoo.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "no"
}
{
"email": "user1@outlook.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "no"
}
{
"email": "user2@hotmail.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "no"
}
-tm disposable mode only skipping SMTP server checks with email addresses in file emaillist.txt
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm disposable -v
[
{
"email": "user@mailsac.com",
"status": "not_disposable",
"status_code": null,
"free_email": "yes",
"disposable_email": "yes"
},
{
"email": "xyz@centmil1.com",
"status": "not_disposable",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user+to@domain1.com",
"status": "not_disposable",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "xyz@domain1.com",
"status": "not_disposable",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "abc@domain1.com",
"status": "not_disposable",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "123@domain1.com",
"status": "not_disposable",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "pop@domain1.com",
"status": "not_disposable",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "pip@domain1.com",
"status": "not_disposable",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@tempr.email",
"status": "not_disposable",
"status_code": null,
"free_email": "no",
"disposable_email": "yes"
},
{
"email": "info@domain2.com",
"status": "not_disposable",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@gmail.com",
"status": "not_disposable",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "op999@gmail.com",
"status": "not_disposable",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user@yahoo.com",
"status": "not_disposable",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user1@outlook.com",
"status": "not_disposable",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user2@hotmail.com",
"status": "not_disposable",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
}
]
-tm dns mode only skipping SMTP server checks with email addresses in file emaillist.txt
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm dns -v
[
{
"email": "user@mailsac.com",
"status": "valid_dns",
"status_code": null,
"free_email": "yes",
"disposable_email": "notchecked"
},
{
"email": "xyz@centmil1.com",
"status": "invalid",
"status_code": null,
"free_email": "unknown",
"disposable_email": "notchecked"
},
{
"email": "user+to@domain1.com",
"status": "valid_dns",
"status_code": null,
"free_email": "no",
"disposable_email": "notchecked"
},
{
"email": "xyz@domain1.com",
"status": "valid_dns",
"status_code": null,
"free_email": "no",
"disposable_email": "notchecked"
},
{
"email": "abc@domain1.com",
"status": "valid_dns",
"status_code": null,
"free_email": "no",
"disposable_email": "notchecked"
},
{
"email": "123@domain1.com",
"status": "valid_dns",
"status_code": null,
"free_email": "no",
"disposable_email": "notchecked"
},
{
"email": "pop@domain1.com",
"status": "valid_dns",
"status_code": null,
"free_email": "no",
"disposable_email": "notchecked"
},
{
"email": "pip@domain1.com",
"status": "valid_dns",
"status_code": null,
"free_email": "no",
"disposable_email": "notchecked"
},
{
"email": "user@tempr.email",
"status": "valid_dns",
"status_code": null,
"free_email": "no",
"disposable_email": "notchecked"
},
{
"email": "info@domain2.com",
"status": "valid_dns",
"status_code": null,
"free_email": "no",
"disposable_email": "notchecked"
},
{
"email": "user@gmail.com",
"status": "valid_dns",
"status_code": null,
"free_email": "yes",
"disposable_email": "notchecked"
},
{
"email": "op999@gmail.com",
"status": "valid_dns",
"status_code": null,
"free_email": "yes",
"disposable_email": "notchecked"
},
{
"email": "user@yahoo.com",
"status": "valid_dns",
"status_code": null,
"free_email": "yes",
"disposable_email": "notchecked"
},
{
"email": "user1@outlook.com",
"status": "valid_dns",
"status_code": null,
"free_email": "yes",
"disposable_email": "notchecked"
},
{
"email": "user2@hotmail.com",
"status": "valid_dns",
"status_code": null,
"free_email": "yes",
"disposable_email": "notchecked"
}
]
Logging SMTP server response displayed in -v verbose mode with email addresses in file emaillist.txt will create a 2nd debug log email_verification_log_debug_*.log with entries.
ls -lhArt | tail -2
-rw-r--r-- 1 root root 9.8K May 4 23:35 email_verification_log_debug_2024-05-04_23-35-47.log
-rw-r--r-- 1 root root 6.0K May 4 23:35 email_verification_log_2024-05-04_23-35-47.log
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -v
[
{
"email": "user@mailsac.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "yes"
},
{
"email": "xyz@centmil1.com",
"status": "invalid",
"status_code": null,
"free_email": "unknown",
"disposable_email": "no"
},
{
"email": "user+to@domain1.com",
"status": "ok",
"status_code": 250,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "xyz@domain1.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "abc@domain1.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "123@domain1.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "pop@domain1.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "pip@domain1.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@tempr.email",
"status": "ok",
"status_code": 250,
"free_email": "no",
"disposable_email": "yes"
},
{
"email": "info@domain2.com",
"status": "ok",
"status_code": 250,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@gmail.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "op999@gmail.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user@yahoo.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user1@outlook.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user2@hotmail.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "no"
}
]
Regular non-verbose log email_verification_log_2024-05-04_23-35-47.log will also show the smtp profile used to do the SMTP check testing as well as Acceptable failure rate metrics per domain.
cat email_verification_log_2024-05-04_23-35-47.log
2024-05-04 23:35:48,080 - INFO - Disposable email address: user@mailsac.com
2024-05-04 23:35:48,082 - INFO - Disposable email address: user@tempr.email
2024-05-04 23:35:48,626 - INFO - SMTP response for user@mailsac.com using profile [default]: 250, b'Accepted'
2024-05-04 23:35:49,022 - INFO - SMTP response for user@tempr.email using profile [default]: 250, b'2.1.5 Ok'
2024-05-04 23:35:49,082 - INFO - Validating user+to@domain1.com
2024-05-04 23:35:49,082 - INFO - Email DNS is valid: user+to@domain1.com
2024-05-04 23:35:49,082 - INFO - Validating 123@domain1.com
2024-05-04 23:35:49,082 - INFO - Validating abc@domain1.com
2024-05-04 23:35:49,082 - INFO - Validating xyz@domain1.com
2024-05-04 23:35:49,082 - INFO - Validating pop@domain1.com
2024-05-04 23:35:49,082 - INFO - Email DNS is valid: pop@domain1.com
2024-05-04 23:35:49,082 - INFO - Email DNS is valid: 123@domain1.com
2024-05-04 23:35:49,082 - INFO - Email DNS is valid: abc@domain1.com
2024-05-04 23:35:49,082 - INFO - Email DNS is valid: xyz@domain1.com
2024-05-04 23:35:49,082 - INFO - Validating pip@domain1.com
2024-05-04 23:35:49,083 - INFO - Validating info@domain2.com
2024-05-04 23:35:49,083 - INFO - Email DNS is valid: pip@domain1.com
2024-05-04 23:35:49,083 - INFO - Email DNS is valid: info@domain2.com
2024-05-04 23:35:49,084 - INFO - Validating user2@hotmail.com
2024-05-04 23:35:49,084 - INFO - Email DNS is valid: user2@hotmail.com
2024-05-04 23:35:49,646 - INFO - SMTP response for pop@domain1.com using profile [default]: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1 https://support.google.com/mail/?p=NoSuchUser h14-20020a05640250ce00b00572b21fb7d5si3202708edb.683 - gsmtp"
2024-05-04 23:35:49,666 - INFO - SMTP response for 123@domain1.com using profile [default]: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1 https://support.google.com/mail/?p=NoSuchUser sh43-20020a1709076eab00b00a597a01b74csi2965444ejc.273 - gsmtp"
2024-05-04 23:35:49,672 - INFO - SMTP response for abc@domain1.com using profile [default]: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1 https://support.google.com/mail/?p=NoSuchUser gt34-20020a1709072da200b00a597ff2fc04si2617860ejc.981 - gsmtp"
2024-05-04 23:35:49,675 - INFO - SMTP response for pip@domain1.com using profile [default]: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1 https://support.google.com/mail/?p=NoSuchUser p14-20020aa7d30e000000b00572d0cb1e66si1718373edq.661 - gsmtp"
2024-05-04 23:35:49,694 - INFO - SMTP response for xyz@domain1.com using profile [default]: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1 https://support.google.com/mail/?p=NoSuchUser wg10-20020a17090705ca00b00a5999e2028dsi2138359ejb.514 - gsmtp"
2024-05-04 23:35:49,752 - INFO - SMTP response for info@domain2.com using profile [default]: 250, b'2.1.5 OK j7-20020a5d5647000000b0034cfd826251si3647095wrw.519 - gsmtp'
2024-05-04 23:35:49,753 - INFO - SMTP response for user+to@domain1.com using profile [default]: 250, b'2.1.5 OK m8-20020a056402430800b005721e7edb0fsi3177955edc.665 - gsmtp'
2024-05-04 23:35:49,761 - INFO - SMTP response for user2@hotmail.com using profile [default]: 250, b'2.1.5 Recipient OK'
2024-05-04 23:35:50,085 - INFO - Validating user@gmail.com
2024-05-04 23:35:50,085 - INFO - Email DNS is valid: user@gmail.com
2024-05-04 23:35:50,085 - INFO - Validating op999@gmail.com
2024-05-04 23:35:50,085 - INFO - Validating user@yahoo.com
2024-05-04 23:35:50,086 - INFO - Email DNS is valid: op999@gmail.com
2024-05-04 23:35:50,086 - INFO - Email DNS is valid: user@yahoo.com
2024-05-04 23:35:50,086 - INFO - Validating user1@outlook.com
2024-05-04 23:35:50,086 - INFO - Email DNS is valid: user1@outlook.com
2024-05-04 23:35:50,545 - INFO - SMTP response for user1@outlook.com using profile [default]: 250, b'2.1.5 Recipient OK'
2024-05-04 23:35:50,659 - INFO - SMTP response for op999@gmail.com using profile [default]: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1 https://support.google.com/mail/?p=NoSuchUser w9-20020a5d4049000000b0034ddab36ff8si3678827wrp.499 - gsmtp"
2024-05-04 23:35:50,801 - INFO - SMTP response for user@gmail.com using profile [default]: 250, b'2.1.5 OK d7-20020a05600c34c700b0041d7d5787bfsi3791910wmq.193 - gsmtp'
2024-05-04 23:35:50,802 - INFO - SMTP response for user@yahoo.com using profile [default]: 250, b'recipient <user@yahoo.com> ok'
2024-05-04 23:35:50,802 - INFO - Acceptable failure rate (0.00%) for domain mailsac.com.
2024-05-04 23:35:50,802 - INFO - Acceptable failure rate (0.00%) for domain tempr.email.
2024-05-04 23:35:50,802 - INFO - Acceptable failure rate (0.00%) for domain domain1.com.
2024-05-04 23:35:50,802 - INFO - Acceptable failure rate (0.00%) for domain domain2.com.
2024-05-04 23:35:50,802 - INFO - Acceptable failure rate (0.00%) for domain hotmail.com.
2024-05-04 23:35:50,803 - INFO - Acceptable failure rate (0.00%) for domain outlook.com.
2024-05-04 23:35:50,803 - INFO - Acceptable failure rate (0.00%) for domain gmail.com.
2024-05-04 23:35:50,803 - INFO - Acceptable failure rate (0.00%) for domain yahoo.com.
Verbose debug log email_verification_log_debug_2024-05-04_23-35-47.log
cat email_verification_log_debug_2024-05-04_23-35-47.log
2024-05-04 23:35:48,080 - DEBUG - Connecting to SMTP server alt.mailsac.com. on port 25
2024-05-04 23:35:48,083 - DEBUG - Connecting to SMTP server mx.discard.email. on port 25
2024-05-04 23:35:48,328 - DEBUG - SMTP connection established
2024-05-04 23:35:48,403 - DEBUG - EHLO command sent
2024-05-04 23:35:48,403 - DEBUG - Sending MAIL FROM command: user@domain1.com
2024-05-04 23:35:48,477 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:48,477 - DEBUG - Sending RCPT TO command for: user@mailsac.com
2024-05-04 23:35:48,552 - DEBUG - RCPT TO response: 250, b'Accepted'
2024-05-04 23:35:48,626 - DEBUG - SMTP session closed
2024-05-04 23:35:48,642 - DEBUG - SMTP connection established
2024-05-04 23:35:48,737 - DEBUG - EHLO command sent
2024-05-04 23:35:48,737 - DEBUG - Sending MAIL FROM command: user@domain1.com
2024-05-04 23:35:48,832 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:48,832 - DEBUG - Sending RCPT TO command for: user@tempr.email
2024-05-04 23:35:48,927 - DEBUG - RCPT TO response: 250, b'2.1.5 Ok'
2024-05-04 23:35:49,022 - DEBUG - SMTP session closed
2024-05-04 23:35:49,082 - DEBUG - Connecting to SMTP server aspmx5.googlemail.com. on port 25
2024-05-04 23:35:49,083 - DEBUG - Connecting to SMTP server aspmx5.googlemail.com. on port 25
2024-05-04 23:35:49,083 - DEBUG - Connecting to SMTP server aspmx5.googlemail.com. on port 25
2024-05-04 23:35:49,083 - DEBUG - Connecting to SMTP server aspmx5.googlemail.com. on port 25
2024-05-04 23:35:49,083 - DEBUG - Connecting to SMTP server aspmx5.googlemail.com. on port 25
2024-05-04 23:35:49,084 - DEBUG - Connecting to SMTP server aspmx5.googlemail.com. on port 25
2024-05-04 23:35:49,084 - DEBUG - Connecting to SMTP server aspmx2.googlemail.com. on port 25
2024-05-04 23:35:49,084 - DEBUG - Connecting to SMTP server hotmail-com.olc.protection.outlook.com. on port 25
2024-05-04 23:35:49,277 - DEBUG - SMTP connection established
2024-05-04 23:35:49,277 - DEBUG - SMTP connection established
2024-05-04 23:35:49,285 - DEBUG - SMTP connection established
2024-05-04 23:35:49,291 - DEBUG - SMTP connection established
2024-05-04 23:35:49,294 - DEBUG - SMTP connection established
2024-05-04 23:35:49,305 - DEBUG - SMTP connection established
2024-05-04 23:35:49,307 - DEBUG - SMTP connection established
2024-05-04 23:35:49,367 - DEBUG - EHLO command sent
2024-05-04 23:35:49,367 - DEBUG - Sending MAIL FROM command: user@domain1.com
2024-05-04 23:35:49,367 - DEBUG - EHLO command sent
2024-05-04 23:35:49,367 - DEBUG - Sending MAIL FROM command: user@domain1.com
2024-05-04 23:35:49,382 - DEBUG - EHLO command sent
2024-05-04 23:35:49,382 - DEBUG - Sending MAIL FROM command: user@domain1.com
2024-05-04 23:35:49,383 - DEBUG - EHLO command sent
2024-05-04 23:35:49,384 - DEBUG - Sending MAIL FROM command: user@domain1.com
2024-05-04 23:35:49,397 - DEBUG - EHLO command sent
2024-05-04 23:35:49,397 - DEBUG - Sending MAIL FROM command: user@domain1.com
2024-05-04 23:35:49,399 - DEBUG - EHLO command sent
2024-05-04 23:35:49,399 - DEBUG - Sending MAIL FROM command: user@domain1.com
2024-05-04 23:35:49,401 - DEBUG - EHLO command sent
2024-05-04 23:35:49,401 - DEBUG - Sending MAIL FROM command: user@domain1.com
2024-05-04 23:35:49,455 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:49,455 - DEBUG - Sending RCPT TO command for: user+to@domain1.com
2024-05-04 23:35:49,455 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:49,455 - DEBUG - Sending RCPT TO command for: pop@domain1.com
2024-05-04 23:35:49,473 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:49,473 - DEBUG - Sending RCPT TO command for: 123@domain1.com
2024-05-04 23:35:49,474 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:49,474 - DEBUG - Sending RCPT TO command for: abc@domain1.com
2024-05-04 23:35:49,485 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:49,485 - DEBUG - Sending RCPT TO command for: pip@domain1.com
2024-05-04 23:35:49,494 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:49,494 - DEBUG - Sending RCPT TO command for: xyz@domain1.com
2024-05-04 23:35:49,500 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:49,500 - DEBUG - Sending RCPT TO command for: info@domain2.com
2024-05-04 23:35:49,530 - DEBUG - SMTP connection established
2024-05-04 23:35:49,558 - DEBUG - RCPT TO response: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1 https://support.google.com/mail/?p=NoSuchUser h14-20020a05640250ce00b00572b21fb7d5si3202708edb.683 - gsmtp"
2024-05-04 23:35:49,576 - DEBUG - RCPT TO response: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1 https://support.google.com/mail/?p=NoSuchUser sh43-20020a1709076eab00b00a597a01b74csi2965444ejc.273 - gsmtp"
2024-05-04 23:35:49,580 - DEBUG - RCPT TO response: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1 https://support.google.com/mail/?p=NoSuchUser gt34-20020a1709072da200b00a597ff2fc04si2617860ejc.981 - gsmtp"
2024-05-04 23:35:49,586 - DEBUG - EHLO command sent
2024-05-04 23:35:49,586 - DEBUG - Sending MAIL FROM command: user@domain1.com
2024-05-04 23:35:49,587 - DEBUG - RCPT TO response: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1 https://support.google.com/mail/?p=NoSuchUser p14-20020aa7d30e000000b00572d0cb1e66si1718373edq.661 - gsmtp"
2024-05-04 23:35:49,600 - DEBUG - RCPT TO response: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1 https://support.google.com/mail/?p=NoSuchUser wg10-20020a17090705ca00b00a5999e2028dsi2138359ejb.514 - gsmtp"
2024-05-04 23:35:49,639 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:49,639 - DEBUG - Sending RCPT TO command for: user2@hotmail.com
2024-05-04 23:35:49,646 - DEBUG - SMTP session closed
2024-05-04 23:35:49,651 - DEBUG - RCPT TO response: 250, b'2.1.5 OK j7-20020a5d5647000000b0034cfd826251si3647095wrw.519 - gsmtp'
2024-05-04 23:35:49,665 - DEBUG - RCPT TO response: 250, b'2.1.5 OK m8-20020a056402430800b005721e7edb0fsi3177955edc.665 - gsmtp'
2024-05-04 23:35:49,666 - DEBUG - SMTP session closed
2024-05-04 23:35:49,672 - DEBUG - SMTP session closed
2024-05-04 23:35:49,675 - DEBUG - SMTP session closed
2024-05-04 23:35:49,694 - DEBUG - SMTP session closed
2024-05-04 23:35:49,709 - DEBUG - RCPT TO response: 250, b'2.1.5 Recipient OK'
2024-05-04 23:35:49,752 - DEBUG - SMTP session closed
2024-05-04 23:35:49,753 - DEBUG - SMTP session closed
2024-05-04 23:35:49,761 - DEBUG - SMTP session closed
2024-05-04 23:35:50,085 - DEBUG - Connecting to SMTP server alt2.gmail-smtp-in.l.google.com. on port 25
2024-05-04 23:35:50,086 - DEBUG - Connecting to SMTP server alt2.gmail-smtp-in.l.google.com. on port 25
2024-05-04 23:35:50,086 - DEBUG - Connecting to SMTP server mta6.am0.yahoodns.net. on port 25
2024-05-04 23:35:50,086 - DEBUG - Connecting to SMTP server outlook-com.olc.protection.outlook.com. on port 25
2024-05-04 23:35:50,314 - DEBUG - SMTP connection established
2024-05-04 23:35:50,314 - DEBUG - SMTP connection established
2024-05-04 23:35:50,402 - DEBUG - EHLO command sent
2024-05-04 23:35:50,402 - DEBUG - Sending MAIL FROM command: user@domain1.com
2024-05-04 23:35:50,407 - DEBUG - EHLO command sent
2024-05-04 23:35:50,407 - DEBUG - Sending MAIL FROM command: user@domain1.com
2024-05-04 23:35:50,451 - DEBUG - SMTP connection established
2024-05-04 23:35:50,472 - DEBUG - EHLO command sent
2024-05-04 23:35:50,472 - DEBUG - Sending MAIL FROM command: user@domain1.com
2024-05-04 23:35:50,484 - DEBUG - SMTP connection established
2024-05-04 23:35:50,486 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:50,486 - DEBUG - Sending RCPT TO command for: op999@gmail.com
2024-05-04 23:35:50,492 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:50,493 - DEBUG - Sending RCPT TO command for: user1@outlook.com
2024-05-04 23:35:50,497 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:50,498 - DEBUG - Sending RCPT TO command for: user@gmail.com
2024-05-04 23:35:50,525 - DEBUG - RCPT TO response: 250, b'2.1.5 Recipient OK'
2024-05-04 23:35:50,545 - DEBUG - SMTP session closed
2024-05-04 23:35:50,561 - DEBUG - EHLO command sent
2024-05-04 23:35:50,561 - DEBUG - Sending MAIL FROM command: user@domain1.com
2024-05-04 23:35:50,575 - DEBUG - RCPT TO response: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1 https://support.google.com/mail/?p=NoSuchUser w9-20020a5d4049000000b0034ddab36ff8si3678827wrp.499 - gsmtp"
2024-05-04 23:35:50,641 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:50,641 - DEBUG - Sending RCPT TO command for: user@yahoo.com
2024-05-04 23:35:50,659 - DEBUG - SMTP session closed
2024-05-04 23:35:50,710 - DEBUG - RCPT TO response: 250, b'2.1.5 OK d7-20020a05600c34c700b0041d7d5787bfsi3791910wmq.193 - gsmtp'
2024-05-04 23:35:50,720 - DEBUG - RCPT TO response: 250, b'recipient <user@yahoo.com> ok'
2024-05-04 23:35:50,801 - DEBUG - SMTP session closed
2024-05-04 23:35:50,802 - DEBUG - SMTP session closed
syntax only test without smtp and dns test
python validate_emails.py -f user@domain.com -e user+to@domain.com -tm syntax
[
{
"email": "user@mailsac.com",
"status": "valid_format",
"status_code": null,
"free_email": "yes",
"disposable_email": "notchecked"
},
{
"email": "xyz@centmil1.com",
"status": "valid_format",
"status_code": null,
"free_email": "no",
"disposable_email": "notchecked"
},
{
"email": "user+to@domain1.com",
"status": "valid_format",
"status_code": null,
"free_email": "no",
"disposable_email": "notchecked"
},
{
"email": "xyz@domain1.com",
"status": "valid_format",
"status_code": null,
"free_email": "no",
"disposable_email": "notchecked"
},
{
"email": "abc@domain1.com",
"status": "valid_format",
"status_code": null,
"free_email": "no",
"disposable_email": "notchecked"
},
{
"email": "123@domain1.com",
"status": "valid_format",
"status_code": null,
"free_email": "no",
"disposable_email": "notchecked"
},
{
"email": "pop@domain1.com",
"status": "valid_format",
"status_code": null,
"free_email": "no",
"disposable_email": "notchecked"
},
{
"email": "pip@domain1.com",
"status": "valid_format",
"status_code": null,
"free_email": "no",
"disposable_email": "notchecked"
},
{
"email": "user@tempr.email",
"status": "valid_format",
"status_code": null,
"free_email": "no",
"disposable_email": "notchecked"
},
{
"email": "info@domain2.com",
"status": "valid_format",
"status_code": null,
"free_email": "no",
"disposable_email": "notchecked"
},
{
"email": "user@gmail.com",
"status": "valid_format",
"status_code": null,
"free_email": "yes",
"disposable_email": "notchecked"
},
{
"email": "op999@gmail.com",
"status": "valid_format",
"status_code": null,
"free_email": "yes",
"disposable_email": "notchecked"
},
{
"email": "user@yahoo.com",
"status": "valid_format",
"status_code": null,
"free_email": "yes",
"disposable_email": "notchecked"
},
{
"email": "user1@outlook.com",
"status": "valid_format",
"status_code": null,
"free_email": "yes",
"disposable_email": "notchecked"
},
{
"email": "user2@hotmail.com",
"status": "valid_format",
"status_code": null,
"free_email": "yes",
"disposable_email": "notchecked"
}
]
In additional to local self-hosted email verification, the script now has added support for the following external Email cleaning service APIs - EmailListVerify, MillionVerifier, MyEmailVerifier, CaptainVerify, Proofy.io, Zerobounce, Reoon, Bouncify, Bounceless. Links to services maybe affiliate links. If you found this information useful ;)
Updated: Added API Merge support via -apimerge argument to merge EmailListVerify + MillionVerifier API results together for more accurate email verification results.
validate_emails.py supports passing individual email's comma separated via -e flag i.e. -e user@domain1.com,user@domain2.com or passing -l flag for a text file with list of email addresses one per line via -l emaillist.txt. Both methods use respetive provider's per email verification APIs. Only some providers have support in the script for bulk email API - which is currently EmailListVerify and MillionVerifier via -apibulk flag i.e. -l emaillist.txt -apibulk emaillistverify or -l emaillist.txt -apibuilk millionverifier.
You can see a full list and explanation of all argument flags supported at here.
The -api flag determines which provider you use along with their respective -apikey* flag.
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api captainverify -apikey_cv $cvkey
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api proofy -apikey_pf $pkey -apiuser_pf $puser
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api myemailverifier -apikey_mev $mevkey
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api zerobounce -apikey_zb $zbkey
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api reoon -apikey_rn $reokey
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api bouncify -apikey_bf $bfkey
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api bounceless -apikey_bf $blkey
Notes:
- Some providers have enabled optional Cloudflare HTTP Forward Proxy Cache With KV Storage
- All providers support optional
-storeflag to save email verification results to remote S3 storage i.e. Amazon AWS S3 or Cloudflare R2 object storage buckets - There's also work on a PHP Wrapper script.
Personal experience with all commercial email verification providers:
-
Disclaimer: I've already been using EmailListVerify since 2015 and Proofy.io since 2022. While the rest of the mentioned providers are new experiences for me.
-
EmailListVerify and MillionVerifier while being cheaper than the others seem to be better for the following:
- API documentation
- Less restrictive on API connection and rate limits. Meaning if you are doing per email API checks for many email addresses, the speed of completion will be faster. Though if you're doing many email address checks, you'd want to use their respective bulk email API end points to upload a single text file for processing.
- For bulk API speed though, MillionVerifier is much faster than EmailListVerify. Even MillionVerifier's per email check API speed can be as low as 100ms for check and has a rate limit of 400 emails/second per unqiue IP address. For the sample 15 email addresses tested below, MillionVerifier bulk API took ~7 seconds, EmailListVerify bulk API took ~45 seconds. Compared to per email address verification checks, both taking between 2.2 to 3.3 seconds. EmailListVerify seems to have much more detailed status classifications (see below) compared to ther others so more processing is done on their end.
-
MillionVerifier has email verification speed information here
-
MillionVerifier allow for a maximum 2 simultaneous bulk file API uploads at a time and max size of files uploaded are 1 million emails per file or 100MB size. If each of the files contains more than 1000 emails, they will verify a maximum of 2 files at a time.
-
MillionVerifier API logging for billing is the mosted detailed with historical running balances. They also show per API call credit usage balance details and even list in the logs refunded credits for bulk API file uploaded emails classified as 'risky' (
catch_allorunknown) https://help.millionverifier.com/payments-credits/refund-for-risky-emails. AFAIK, the other providers don't refund any credits that I can see. However, on below sample 15 email addresses tested, I always got 1 refunded credit so it applies to one email address which is a known valid emailuser@yahoo.comwhich is classed asunknownin bulk API but classed asokin per email verification API. Seems to be a bug in their bulk API then as the refunds only apply to bulk API and not per email verification checks due to differences in classifications in bulk API vs per email verification API.I reached out to MillionVerifier chat support which was initially handled via Milly their AI chat bot which later referred me to support. They emailed me back saying:
We're glad you reached out to us about this issue, and we're here to help. The discrepancy you're seeing in the results is likely because we were unable to connect to the server during the verification process, leading to an "Unknown" result. However, for the single API, the connection went through smoothly, allowing us to verify the email without any problems. An "Unknown" result simply means that we couldn't determine the existence of the email at the time of verification. If you have any more questions, queries, or issues, we're more than happy to assist.
I tried a few attempts at bulk API for the same list of 15 emails, and
user@yahoo.comis always marked as status =unknownand never anything different though? It would be hard to differentiate status classifications if it's due connection issues if they're lumped into other emails in unknown label. Maybe would be better to have a separate classification for connection issues so we can differentiate as such. For example, EmailListVerify has 18 different status classifications including for connection related issues.MillionVerifier follow up - support investigated the issue on their end and said:
We're really glad you reached out to us about this issue, and we've done our best to get to the bottom of it. Thank you for your patience while we looked into this. It turns out the issue wasn't about whether you were verifying emails in bulk or one at a time, but rather which server was used for the verification. Also, if you try to verify some emails multiple times, they might eventually return an "Unknown" result. I'd also like to point out that we don't deduct credits for emails marked as "Risky" during API calls. You won't see a credit refund for these in your Credit Balance because we only charge for emails identified as "Good" or "Bad." > The credits for "Risky" emails aren't taken away in the first place.
I confirmed this occurs on MillionVerifier single email verification as well if you test it enough times for
user@yahoo.comemail address specifically.single email API check for
user@yahoo.comreturnsokpython validate_emails.py -f user@domain1.com -e user@yahoo.com -api millionverifier -apikey_mv $mvkey -tm all [ { "email": "user@yahoo.com", "status": "ok", "status_code": null, "free_email": "yes", "disposable_email": "no", "free_email_api": true, "role_api": false } ]bulk API upload check excerpt for
user@yahoo.comreturnsunknownpython validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey -apibulk millionverifier [ { "email": "user@yahoo.com", "status": "unknown", "free_email": "yes", "disposable_email": "no", "free_email_api": "yes", "role_api": "no" }, ]As such you can't 100% rely on the status output to do tasks like updating Xenforo user's
user_statestatus to stop sending emails to them without further verification for such emails. For now, I've updated myvalidate_emails.pyscript for MillionVerifier bulk API and per email check API results, to not list Xenforo SQL queries forunknownstatus results and only list Xenforo SQL queries forinvalidanddisposablestatus emails. Same can be said for other providers, probably need to really double check your results if you're relying on the results for important tasks. You can filter MillionVerifier'sunknownstatus emails and feed them into another commercial provider's API to double check i.e. EmailListVerify or use script's self-hosted local email check. Given cheaper MillionVerifier pricing, it might be more economical to do it this way?MillionVerifier bulk API filter
-api millionverifier -apikey_mv $mvkey -apibulk millionverifierfilter usingjqforunknownstatus emails piped into text fileresults-millionverifier-bulk-api-unknown-only.txtpython validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey -apibulk millionverifier | jq '.[] | select(.status == "unknown")' 2>&1 > results-millionverifier-bulk-api-unknown-only.txtThe
results-millionverifier-bulk-api-unknown-only.txtcontents will show all MillionVerifier bulk API returnedunknownstatus results.cat results-millionverifier-bulk-api-unknown-only.txt { "email": "user@yahoo.com", "status": "unknown", "free_email": "yes", "disposable_email": "no", "free_email_api": "yes", "role_api": "no" }Using same
results-millionverifier-bulk-api-unknown-only.txtfile, andjqjust filter out the email addresses into a newresults-millionverifier-bulk-api-unknown-only-emails.txtfilecat results-millionverifier-bulk-api-unknown-only.txt | jq -r '.email' | tee results-millionverifier-bulk-api-unknown-only-emails.txt user@yahoo.comThen use EmailListVerify bulk API to verify the filtered MillionVerifier
unknownstatus list filtered fileresults-millionverifier-bulk-api-unknown-only-emails.txtand double check the status which confirms it's actually avalidemail.python validate_emails.py -f user@domain1.com -l results-millionverifier-bulk-api-unknown-only-emails.txt -tm all -api emaillistverify -apikey $elvkey -apibulk emaillistverify [ { "email": "user@yahoo.com", "status": "valid", "status_code": "", "free_email": "yes", "disposable_email": "no" } ]Or EmailListVerify per email verification API check
./validate_emails.py -f user@domain1.com -e user@yahoo.com -tm all -api emaillistverify -apikey $elvkey -tm all [ { "email": "user@yahoo.com", "status": "valid", "status_code": null, "free_email": "yes", "disposable_email": "no" } ]Or if it's a few emails, via
validate_emails.pyscript's self-hosted local email syntax, DNS and SMTP checkvalidate_emails.py -f user@domain1.com -e user@yahoo.com -tm all [ { "email": "user@yahoo.com", "status": "ok", "status_code": 250, "free_email": "yes", "disposable_email": "no" } ] -
MyEmailVerifier API is limited to 30 requests per minute for per email address verification checks. For the sample 15 email addresses tested below, took ~5.5 seconds to complete per email address verification checks
-
MyEmailVerifier API logging doesn't seem to work. Waited a few days and none of my API tests were logged in their API logging on their dashboard web site.
-
CaptainVerify API is limited to a maximum of 2 simultaneous connections and 50 checks per minute for per email address verification checks. For the sample 15 email addresses tested below, took ~4.6 seconds to complete per email address verification checks
-
Proofy.io has the most restrictive API limits but I can't seem to find any documentation of the actual limits, so I have to code it so it isn't as fast as other providers for per email verification checks. It will be the slowest of the 5 providers for per email verification checks. For the sample 15 email addresses tested below, took ~9.5 seconds to complete per email address verification checks
-
Proofy.io only has single email check and batch email checks but no bulk file API support.
-
ZeroBounce API was added on May 11, 2024. For sample 15 email addresses, it took 4.794 seconds via per email check API. They have 100 free email credits per month, making it possible to keep my script's support and development testing costs down to a minimum. API documentation is very well documented.
-
ZeroBounce, only annoying issues right now are on their web site end and not their API specifically:
- initial login to web site dashboard are very slow as is reloading the dashboard i.e. browser F5 refresh. Sometimes just stuck with their purple reloading page progress icon that never actually loads the web page/dashboard.
- the web site login session durations are very short, so annoyingly you get logged out very quickly making it more secure. Make sure you use a password manager to make re-logins less annoying. Though if you're using a script and their API, you don't have to login as frequently.
-
ZeroBounce offers per email, batch email and bulk file API endpoints.
-
ZeroBounce doesn't charge for
unknownstatus emails -
ZeroBounce API rate limit speeds are outlined in there documentation here - 50,000 requests in 10 seconds (validations) before temporarily blocking for 1 minute. A maximum of 250 requests in 1 minute for the
bulkapi.zerobounce.net/before temporarily blocking for 1 hour. And allow a maximum of 20 requests in 1 minute for thebulkapi.zerobounce.net/v2/validatebatchbefore temporarily blocking for 10 minutes. Rate limits seem more complicated so will need to test my script to ensure it operates under their rate limits. -
Reoon as added on May 12, 2024 and per email verification API should be kept at less than 5 concurrent threads. They say they take around 20 minutes to verify a set of 50,000 mixed-quality email addresses. For bulk email API, max is 50,000 emails per list. A bit on the low side given some other providers allow a max 1 million emails per list. The 15 email address sameple test took 2.176 seconds to complete.
-
Reoon unfortunately incorrectly classified
op999@gmail.comas avalidemail when it isn't and marked by all other APIs asinvalid/undeliverable/email_disabled. This seems to be due to Reoon having 2 modes for their single email verification API for aquickandpowermodes. My initial tests are withquickmode. But I will need to do testing withpowermode in future. Even their web site dashboard based single email verification check returns correctinvalidstatus for this email suggesting they usedpowermode there too. I honestly do not know why anyone would usequickmode given how common Gmail email addresses are.- From their documentation:
- The disadvantages of
quickmode verification: Deep verification and detailed information are less available compared to the POWER mode. So individual inbox status will not be checked in this mode. The quick verification mode includes:- Email syntax validation.
- Disposable/temporary email check.
- MX validation and records.
- Domain email acceptance validation.
- Invalid email detection.
- Expired/invalid domain detection.
- Role account check.
- The disadvantages of
- From their documentation:
-
Reoon doesn't charge for
unknownstatus emails -
Reoon do not store any uploaded data for more than 15 days
-
Reon has detailed API credit usage and balance logs just like MillionVerifier
-
Bouncify was added May 12, 2024 and seems to be the slowest to date for API response for single email and 15 sample email address API tests took 184+ seconds even though they have a 120 concurrent request API limit and seem to have trouble validating the
@yahoo.comand@hotmail.comaccounts in my 15 email address sample list here. -
Bouncessless was added May 14, 2024. Probably the 2nd or 3rd slowest per email address verification APIs and seems highly inaccurate on 15 email address sample list not a single known valid email address was deemed as valid by the API. Instead the valid email addresses were all deemed
unknown. After 1/2 day later I retested and Bounceless now fluctuates between anunknownandvalidstatus for known Gmail address. So doesn't seem as reliable for detecting Gmail email addresses compared to other email verification providers tested and compared in the Email Verification Results Table. Bounceless API also doesn't recognise Gmail/Workspace emails using+alias i.e.user+to@domain1.comand deems them as invalid syntax! I double checked this on their web site dashboard anduser+to@domain1.comemail address was still marked as invalid syntax. -
The number of API returned status value classifications returned by the various providers differs. Some have a more detailed classifications for emails than others.
- EmailListVerify has 18 classifications:
- ok
- error
- invalid_mx
- smtp_error
- smtp_protocol
- unknown_email
- attempt_rejected
- relay_error
- antispam_system
- email_disabled
- domain_error
- ok_for_all
- dead_server
- syntax_error
- unknown
- accept_all
- disposable
- spamtrap
- MillionVerifier has 5 classifications:
- ok
- catch_all
- unknown
- disposable
- invalid
- MyEmailVerifier has 4 classifications:
- valid
- invalid
- catch-all
- unknown
- CaptainVerify has 4 classifications:
- valid
- invalid
- risky
- unknown
- Proofy.io has 4 classifications:
- deliverable
- risky
- undeliverable
- unknown
- ZeroBounce has 7 classifications and also 23
sub_statusclassifications:- classifications:
- valid
- invalid
- catch-all
- unknown
- spamtrap
- abuse
- do_not_mail
sub_statusclassifications:- alternate
- antispam_system
- greylisted
- mail_server_temporary_error
- forcible_disconnect
- mail_server_did_not_respond
- timeout_exceeded
- failed_smtp_connection
- mailbox_quota_exceeded
- exception_occurred
- possible_trap
- role_based
- global_suppression
- mailbox_not_found
- no_dns_entries
- failed_syntax_check
- possible_typo
- unroutable_ip_address
- leading_period_removed
- does_not_accept_mail
- alias_address
- role_based_catch_all
- disposable, toxic
- classifications:
- Reoon has 4 classifications
- valid
- invalid
- disposable
- spamtrap
- Bouncify has 4 classifications
- deliverable
- undeliverable
- unknown
- accept-all
- Bounceless has 10 classifications
- blacklist
- catch_all
- disposable
- invalid
- no_mx_record
- role
- timeout
- unknown
- valid
- spamtrap
- EmailListVerify has 18 classifications:
Below are their respectivate pay as you go credit pricing for email verifications. The usual recommendations are to verify your lists every 3-6 months which is 2-4x times per year or prior to a large email sending campaign. Have a 25K email list = 2-4 x 25K = 50-100K email verifications per year.
- Updates:
- May 11, 2024 add Zerobounce API support
- May 12, 2024 add Reoon API support
- May 12, 2024 add Bouncify API support
- May 14, 2024 add Bounceless API support - seems there's difference in pricing for 500K on their web site at US$649 but logged into my dashboard pricing is US$799.
Notes:
- Cheapest provider for each PAYG email bundled of email verifications credits will have a 💲 next to it
- Given the results of the Email Verification Provider API Speed Benchmarks and my personal experiences, the top 4 contenders for me personally would be: Zerobounce, MillionVerifier, EmailListVerify and Reoon. Notes:
- Reoon bulk email API only supports max 50,000 email addresses per list. So if you have 500,000 email addresses to verify, you'd need to use their bulk email API to upload 10x 50K email list files.
- ZeroBounce says they have no limits for bulk email API file sizes or email addresses. However, they also mention if you have email lists 5+ million in size to contact them and they mention for a email list of 100,000 emails it can take between 1 - 3 hours to validate.
- EmailListVerify allows to up to 1 million emails per list.
- MillionVerifier allow for a maximum 2 simultaneous bulk file API uploads at a time and max size of files uploaded are 1 million emails per file or 100MB size. If each of the files contains more than 1000 emails, they will verify a maximum of 2 files at a time.
- MillionVerifier would nearly get the best overall for performance to price ratio, but its sometimes inaccurate classification for valid Yahoo email addresses means you can't rely on it for Yahoo emails at least. Still it's cheap, so you could run all non-Yahoo email addresses through MillionVerifier and separately run Yahoo email addresses through EmailListVerify and still work out cheaper than using Zerobounce. My
validate_emails.pyscript would make such verifications easy to do as it supports multiple email verification API providers in a single script 😎 Though Zerobounce has the fastest API response times.
| Provider | 1k | 2k | 5k | 10k | 25k | 30k | 50k | 70k | 100k |
|---|---|---|---|---|---|---|---|---|---|
| EmailListVerify (demo, results) | $4 (0.0008) 💲 | - | $15 (0.003) 💲 | $24 (0.0024) | $49 (0.00196) | - | $89 (0.00178) | - | $169 (0.00169) |
| MillionVerifier (demo, results) | - | - | - | $37 (0.0037) | $49 (0.00196) | - | $77 (0.00154) | - | $129 (0.00129) |
| MyEmailVerifier (demo, results) | - | $14 (0.007) 💲 | $28 (0.0056) | $39 (0.0039) | $79 (0.00316) | - | $149 (0.00298) | - | $239 (0.00239) |
| CaptainVerify (demo, results) | $7 (0.007) | - | $30 (0.006) | $60 (0.006) | $75 (0.003) | - | $150 (0.003) | - | $200 (0.002) |
| Proofy.io (demo, results) | - | - | $16 (0.0032) | $29 (0.0029) | - | $63 (0.0021) | $99 (0.00198) | $124 (0.00177) | $149 (0.00149) |
| Zerobounce (demo, results) | - | $20 (0.01) | $45 (0.009) | $80 (0.008) | $190 (0.0076) | - | $375 (0.0075) | - | $425 (0.00425) |
| Reoon (demo, results) | - | - | - | $11.91 (0.00119) 💲 | $29.66 (0.00119) 💲 | - | $58.95 (0.00118) 💲 | $87.86 (0.00126) 💲 | $116.40 (0.00116) |
| Bouncify (demo, results) | - | - | - | $19 (0.0019) | - | $39 (0.0013) 💲 | - | - | $99 (0.001) 💲 |
| Bounceless (demo, results) | - | - | $29 (0.0058) | - | $99 (0.00396) | - | - | - | $299 (0.00299) |
| Provider | 200k | 250k | 300k | 500k | 1m | 2.5m | 5m | 10m |
|---|---|---|---|---|---|---|---|---|
| EmailListVerify (demo, results) | - | $349 (0.001396) | - | $449 (0.000898) | $599 (0.000599) | $1190 (0.000476) 💲 | $1990 (0.000398) | $3290 (0.000329) |
| MillionVerifier (demo, results) | - | - | - | $259 (0.000518) 💲 | $389 (0.000389) 💲 | - | $1439 (0.000288) 💲 | $2529 (0.000253) 💲 |
| MyEmailVerifier (demo, results) | - | $349 (0.001396) | - | $549 (0.001098) | $749 (0.000749) | $1249 (0.0005) | $1849 (0.00037) | - |
| CaptainVerify (demo, results) | - | $250 (0.001) 💲 | - | $500 (0.001) | $650 (0.00065) | - | $2000 (0.0004) | - |
| Proofy.io (demo, results) | $229 (0.001145) | - | $289 (0.000963) 💲 | $429 (0.000858) | $699 (0.000699) | $1399 (0.00056) | - | - |
| Zerobounce (demo, results) | - | $940 (0.00376) | - | $1800 (0.0036) | $2750 (0.00275) | - | - | - |
| Reoon (demo, results) | $226.80 (0.00113) | $279.75 (0.00112) | $331.20 (0.00110) | $522.00 (0.00104) | $960.00 (0.00096) | - | - | - |
| Bouncify (demo, results) | $149 (0.00075) 💲 | - | - | $279 (0.00056) | $479 (0.00048) | - | - | - |
| Bounceless (demo, results) | - | - | - | $649 (0.001298) | $899 (0.000899) | - | - | - |
From fastest to slowest ranked from my API tests overall and from gathered API documentation from each respective email verification provider's web site. Speed wise on command line, EmailListVerify and MillionVerifier are neck and neck on per email verification API checks. However, for bulk file API email verification checks, MillionVerifier wins by a lot. Also added tests as a PHP Wrapper where each API providers' times performed differently compared to command line run tests.
MillionVerifier has more detailed email verification speed information for the bulk file email verification here which I assume is for the web site dashboard and not for their API.
Updated: May 11, 2024 add Zerobounce API support. ZeroBounce API rate limit speeds are outlined in there documentation here and will update the below table after I have done some tests.
Updated: May 12, 2024
- add Reoon API support. Will update below table after I have done some tests.
- add Bouncify API support. Will update below table after I have done some tests.
Updated: May 14, 2024
- add Bounceless API support. Will update below table after I have done some tests.
Table also takes into account API rate limits besides my single and 15 email address sample tests. For example, if CaptainVerify takes 20+ seconds to verify a single email address and MyEmailVerifier takes 2-3 seconds, then the higher rate limit per min of CaptainVerify wouldn't matter as CaptainVerify would only be able to handle 3 emails/min versus MyEmailVerifier 20-30 emails/min.
| Provider Rank For API Speed | emails/sec | emails/min |
|---|---|---|
| 1. Zerobounce | 50,000 per 10s but 1 min block | no doc mention |
| 2. MillionVerifier | 400/s | no doc mention |
| 3. EmailListVerify | no doc mention | no doc mention |
| 4. Reoon | no doc mention | no doc mention |
| 5. MyEmailVerifier | no doc mention | 30/min |
| 6. CaptainVerify | no doc mention | 50/min |
| 7. Proofy.io | no doc mention | no doc mention |
| 8. Bounceless | no doc mention | no doc mention |
| 9. Bouncify | no doc mention | 120/min |
Prior to May 16, 2024, the focus for speed of API returned results as based on validate_emails.py completion time, but the Python script uses concurrent threads defined by optional script argument -wf for worker factor to process per email verifications when there's more than 1 email address to process. By default -wf worker factor controlled how many threads were used in validate_emails.py and it defaults to a value of 16 for all API providers except CaptainVerify API and MyEmailVerifier API due to their more restrictive API rate limits, I had to set -wf worker factor to default to 1. As of May 18 2024, Reoon has set -wf to 5 to adhere to their single email address verification API limit of 5 threads maximum. This results in timed validate_emails.py script run completion being slower for CaptainVerify API and MyEmailVerifier API to ensure any API requests do not exceed their respective API rate limits.
So to properly calculate per email verification API response time api_response_time and api_thread_number thread pool number, I also added these metrics to the API JSON response. So to do a email verification check for hnyfmw@canadlan-drugs.com, the API response took 2.0609 seconds while validate_emails.py script run took 4.313 seconds using thread pool 0_0. However, you have to remember that overall speed will depend on the individual API response time and would need to factor in the respective email verification provider's API rate limits.
time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api emaillistverify -apikey $elvkey
[
{
"email": "hnyfmw@canadlan-drugs.com",
"status": "unknown",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"api_response_time": 2.0609,
"api_thread_number": "thread-pool-0_0"
}
]
real 0m4.313s
user 0m0.352s
sys 0m0.029s
With api_response_time and api_thread_number now available in JSON result output, I can now benchmark all tested email verification API providers more accurately for per email verification API response times. Below are the tabulated comparison results. I didn't test Proofy API as I ran out of credits and Proofy doesn't have a bulk file API support and Bounceless API wasn't worth testing given it's inaccurate results for Gmail accounts.
The benchmark tests were against the 15 email address sample list -l emaillist.txt from the commands
# [EmailListVerify](https://centminmod.com/emaillistverify)
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey
# [MillionVerifier](https://centminmod.com/millionverifier)
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey
# [CaptainVerify](https://centminmod.com/captainverify)
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api captainverify -apikey_cv $cvkey
# [MyEmailVerifier](https://centminmod.com/myemailverifier)
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api myemailverifier -apikey_mev $mevkey
# [Zerobounce](https://centminmod.com/zerobounce)
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api zerobounce -apikey_zb $zbkey
# [Reoon](https://centminmod.com/reoon)
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api reoon -apikey_rn $reokey
# [Bouncify](https://centminmod.com/bouncify)
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api bouncify -apikey_bf $bfkey
First table provides the average, min, median, max and 99th percentile API response times for all 15 email addresses broken down by email verification API provider. The table is ordered by provider name alphabetically.
Providers ranked from fastest to slowest for average and maximum API response times for all 15 email addresses checked:
Ranked by Average API Response Time (fastest to slowest) for all 15 email addresses checked:
- zerobounce: Average API Response Time = 0.3922 seconds
- millionverifier: Average API Response Time = 0.4649 seconds
- emaillistverify: Average API Response Time = 1.3805 seconds
- reoon: Average API Response Time = 1.3850 seconds
- captainverify: Average API Response Time = 2.1669 seconds
- myemailverifier: Average API Response Time = 3.9018 seconds
- bouncify: Average API Response Time = 13.3857 seconds
Ranked by Maximum API Response Time (fastest to slowest) for all 15 email addresses checked:
- millionverifier: Max API Response Time = 0.5481 seconds
- zerobounce: Max API Response Time = 1.0279 seconds
- reoon: Max API Response Time = 3.0198 seconds
- emaillistverify: Max API Response Time = 3.1766 seconds
- myemailverifier: Max API Response Time = 4.903 seconds
- captainverify: Max API Response Time = 21.5099 seconds
- bouncify: Max API Response Time = 180.6231 seconds
From the data, we can observe that:
- Zerobounce and MillionVerifier are the fastest email verification API providers in terms of both average and maximum API response times. Zerobounce's average API response times was held back by slow
user@yahoo.comverification check at1.0279seconds (though it was still the fastest API response time that had an accuratestatus). MillionVerifier's average API response times was held back by several checks >0.5 seconds with slowestuser@tempr.emailverification checks0.5481seconds. - If you removed the slowest check for Zerobounce, the remaining 14 sample email addresses would of had an average API response time of
0.347seconds. - If you removed the slowest check for MillionVerifier, the remaining 14 sample email addresses would of had an average API response time of
0.459seconds. - MillionVerifier overall would be fastest if you take into account the max API response times.
- Bouncify is the slowest provider, with the highest average and maximum API response times by a significant margin. The email check for
user2@hotmail.comretuned anapi_errorand API response time for that check was180.6231seconds. If you excluded theapi_errortimed result, the average API response time for remaining 14 sample email addresses would of been1.44seconds. - CaptainVerify has a relatively high maximum API response time of 21.5099 seconds (due to the email check for
xyz@centmil1.com), although its average response time is better than Bouncify and MyEmailVerifier. - Reoon, EmailListVerify, and MyEmailVerifier have relatively similar average and maximum API response times, ranking in the mid-range among the providers.
- However, you have to remember that overall speed will depend on the individual API response time and would need to factor in the respective email verification provider's API rate limits.
| API Provider | Average api_response_time | Min api_response_time | Median api_response_time | Max api_response_time | 99th Percentile api_response_time |
|---|---|---|---|---|---|
| bouncify | 13.3857 | 0.6154 | 1.3655 | 180.6231 | 180.6231 |
| captainverify | 2.1669 | 0.501 | 0.5793 | 21.5099 | 21.5099 |
| emaillistverify | 1.3805 | 0.6449 | 1.1035 | 3.1766 | 3.1766 |
| millionverifier | 0.4649 | 0.4145 | 0.4442 | 0.5481 | 0.5481 |
| myemailverifier | 3.9018 | 2.631 | 4.0985 | 4.903 | 4.903 |
| reoon | 1.3850 | 0.7275 | 1.3763 | 3.0198 | 3.0198 |
| zerobounce | 0.3922 | 0.259 | 0.3464 | 1.0279 | 1.0279 |
Next comparison table shows each of the 15 sample email addresses' individual API response times, returned status check results and also the validated_emails.py script's execution times. Email addresses are sorted alphabetically.
Pay attention to specific email addresses compared for the accuracy of the email verification providers's API results:
user@mailsac.comthis is a known disposable email addressxyz@centmil1.comthis is a domain that doesn't exist so would not have valid DNS or MX DNS recordsuser+to@domain1.comthis is a Google Workspace email address using+user aliasing and is a valid working email addressuser@tempr.emailanother known disposable email addressinfo@domain2.comknown valid Google Workspae email address that is workinguser@gmail.comknown valid Gmail addressop999@gmail.comknown invalid user does not exist Gmail address AFAIKuser@yahoo.comknown valid Yahoo email address that is working. MilliomVerifier Yahoo email address incorrectunknownlabeling showed up in this specific test. According to MillionVerifier support this can happen on some of the API servers and/or if you test an email multiple times.
Notes:
- For
statusresults that I know are incorrect, I've marked them with ❌ next to the result. - For
api_response_timeadded 🏆 for fastest times for each email verification. Foruser@yahoo.comthe fastest inaccurate and accurate results were both marked.
| API Provider | status | api_response_time | free_email | disposable_email | api_thread_number | validated_emails.py Time | |
|---|---|---|---|---|---|---|---|
| 123@domain1.com | bouncify | undeliverable | 1.0689 | no | no | thread-pool-0_5 | 181.576 |
| 123@domain1.com | captainverify | invalid | 0.5636 | no | no | thread-pool-0_5 | 22.836 |
| 123@domain1.com | emaillistverify | email_disabled | 1.0654 | no | no | thread-pool-0_5 | 4.208 |
| 123@domain1.com | millionverifier | invalid | 0.5352 | no | no | thread-pool-0_5 | 1.614 |
| 123@domain1.com | myemailverifier | invalid | 4.663 | no | no | thread-pool-0_5 | 6.461 |
| 123@domain1.com | reoon | unknown | 0.7413 | no | no | thread-pool-0_5 | 5.744 |
| 123@domain1.com | zerobounce | invalid | 0.4128 🏆 | no | no | thread-pool-0_5 | 2.930 |
| abc@domain1.com | bouncify | undeliverable | 2.7131 | no | no | thread-pool-0_4 | 181.576 |
| abc@domain1.com | captainverify | invalid | 0.5862 | no | no | thread-pool-0_4 | 22.836 |
| abc@domain1.com | emaillistverify | email_disabled | 1.0523 | no | no | thread-pool-0_4 | 4.208 |
| abc@domain1.com | millionverifier | invalid | 0.4321 | no | no | thread-pool-0_4 | 1.614 |
| abc@domain1.com | myemailverifier | invalid | 4.903 | no | no | thread-pool-0_4 | 6.461 |
| abc@domain1.com | reoon | unknown | 1.655 | no | no | thread-pool-0_4 | 5.744 |
| abc@domain1.com | zerobounce | invalid | 0.259 🏆 | no | no | thread-pool-0_4 | 2.930 |
| info@domain2.com | bouncify | deliverable | 2.0478 | no | no | thread-pool-0_9 | 181.576 |
| info@domain2.com | captainverify | invalid | 0.5693 | no | no | thread-pool-0_9 | 22.836 |
| info@domain2.com | emaillistverify | valid | 1.3723 | no | no | thread-pool-0_9 | 4.208 |
| info@domain2.com | millionverifier | ok | 0.4314 | no | no | thread-pool-0_9 | 1.614 |
| info@domain2.com | myemailverifier | valid | 3.9004 | no | no | thread-pool-0_9 | 6.461 |
| info@domain2.com | reoon | role_account | 1.478 | no | no | thread-pool-0_9 | 5.744 |
| info@domain2.com | zerobounce | do_not_mail | 0.3873 🏆 | no | no | thread-pool-0_9 | 2.930 |
| op999@gmail.com | bouncify | undeliverable | 1.3655 | yes | no | thread-pool-0_11 | 181.576 |
| op999@gmail.com | captainverify | invalid | 0.5564 | no | no | thread-pool-0_11 | 22.836 |
| op999@gmail.com | emaillistverify | email_disabled | 1.3844 | yes | no | thread-pool-0_11 | 4.208 |
| op999@gmail.com | millionverifier | invalid | 0.4443 | yes | no | thread-pool-0_11 | 1.614 |
| op999@gmail.com | myemailverifier | invalid | 4.5972 | yes | no | thread-pool-0_11 | 6.461 |
| op999@gmail.com | reoon | invalid | 0.9289 | yes | no | thread-pool-0_11 | 5.744 |
| op999@gmail.com | zerobounce | invalid | 0.3605 🏆 | yes | no | thread-pool-0_11 | 2.930 |
| pip@domain1.com | bouncify | undeliverable | 2.0223 | no | no | thread-pool-0_7 | 181.576 |
| pip@domain1.com | captainverify | invalid | 0.5787 | no | no | thread-pool-0_7 | 22.836 |
| pip@domain1.com | emaillistverify | email_disabled | 1.0572 | no | no | thread-pool-0_7 | 4.208 |
| pip@domain1.com | millionverifier | invalid | 0.4273 | no | no | thread-pool-0_7 | 1.614 |
| pip@domain1.com | myemailverifier | invalid | 4.1387 | no | no | thread-pool-0_7 | 6.461 |
| pip@domain1.com | reoon | invalid | 1.0709 | no | no | thread-pool-0_7 | 5.744 |
| pip@domain1.com | zerobounce | invalid | 0.3377 🏆 | no | no | thread-pool-0_7 | 2.930 |
| pop@domain1.com | bouncify | undeliverable | 0.9657 | no | no | thread-pool-0_6 | 181.576 |
| pop@domain1.com | captainverify | invalid | 0.5909 | no | no | thread-pool-0_6 | 22.836 |
| pop@domain1.com | emaillistverify | email_disabled | 1.0636 | no | no | thread-pool-0_6 | 4.208 |
| pop@domain1.com | millionverifier | invalid | 0.5378 | no | no | thread-pool-0_6 | 1.614 |
| pop@domain1.com | myemailverifier | invalid | 3.396 | no | no | thread-pool-0_6 | 6.461 |
| pop@domain1.com | reoon | invalid | 1.5885 | no | no | thread-pool-0_6 | 5.744 |
| pop@domain1.com | zerobounce | invalid | 0.3464 🏆 | no | no | thread-pool-0_6 | 2.930 |
| user+to@domain1.com | bouncify | deliverable | 2.6186 | no | no | thread-pool-0_2 | 181.576 |
| user+to@domain1.com | captainverify | invalid ❌ | 0.6153 | no | no | thread-pool-0_2 | 22.836 |
| user+to@domain1.com | emaillistverify | valid | 0.8685 | no | no | thread-pool-0_2 | 4.208 |
| user+to@domain1.com | millionverifier | ok | 0.4145 | no | no | thread-pool-0_2 | 1.614 |
| user+to@domain1.com | myemailverifier | valid | 3.002 | no | no | thread-pool-0_2 | 6.461 |
| user+to@domain1.com | reoon | valid | 1.6539 | no | no | thread-pool-0_2 | 5.744 |
| user+to@domain1.com | zerobounce | valid | 0.3708 🏆 | no | no | thread-pool-0_2 | 2.930 |
| user1@outlook.com | bouncify | deliverable | 1.6912 | yes | no | thread-pool-0_13 | 181.576 |
| user1@outlook.com | captainverify | valid | 3.5499 | yes | no | thread-pool-0_13 | 22.836 |
| user1@outlook.com | emaillistverify | valid | 1.1035 | yes | no | thread-pool-0_13 | 4.208 |
| user1@outlook.com | millionverifier | ok | 0.4181 | yes | no | thread-pool-0_13 | 1.614 |
| user1@outlook.com | myemailverifier | valid | 4.6978 | yes | no | thread-pool-0_13 | 6.461 |
| user1@outlook.com | reoon | valid | 1.453 | yes | no | thread-pool-0_13 | 5.744 |
| user1@outlook.com | zerobounce | valid | 0.3327 🏆 | yes | no | thread-pool-0_13 | 2.930 |
| user2@hotmail.com | bouncify | api_error ❌ | 180.6231 | yes | no | thread-pool-0_14 | 181.576 |
| user2@hotmail.com | captainverify | invalid | 0.5793 | no | no | thread-pool-0_14 | 22.836 |
| user2@hotmail.com | emaillistverify | valid | 0.6449 | yes | no | thread-pool-0_14 | 4.208 |
| user2@hotmail.com | millionverifier | ok | 0.4245 | yes | no | thread-pool-0_14 | 1.614 |
| user2@hotmail.com | myemailverifier | valid | 4.1951 | yes | no | thread-pool-0_14 | 6.461 |
| user2@hotmail.com | reoon | valid | 1.3763 | yes | no | thread-pool-0_14 | 5.744 |
| user2@hotmail.com | zerobounce | valid | 0.3696 🏆 | yes | no | thread-pool-0_14 | 2.930 |
| user@gmail.com | bouncify | deliverable | 0.678 | yes | no | thread-pool-0_10 | 181.576 |
| user@gmail.com | captainverify | valid | 0.5302 | yes | no | thread-pool-0_10 | 22.836 |
| user@gmail.com | emaillistverify | valid | 1.3648 | yes | no | thread-pool-0_10 | 4.208 |
| user@gmail.com | millionverifier | ok | 0.4417 | yes | no | thread-pool-0_10 | 1.614 |
| user@gmail.com | myemailverifier | valid | 2.631 | yes | no | thread-pool-0_10 | 6.461 |
| user@gmail.com | reoon | valid | 1.1321 | yes | no | thread-pool-0_10 | 5.744 |
| user@gmail.com | zerobounce | valid | 0.3301 🏆 | yes | no | thread-pool-0_10 | 2.930 |
| user@mailsac.com | bouncify | undeliverable | 0.825 | yes | yes | thread-pool-0_0 | 181.576 |
| user@mailsac.com | captainverify | risky | 0.501 | no | yes | thread-pool-0_0 | 22.836 |
| user@mailsac.com | emaillistverify | unknown | 2.0574 | yes | yes | thread-pool-0_0 | 4.208 |
| user@mailsac.com | millionverifier | disposable | 0.516 | yes | yes | thread-pool-0_0 | 1.614 |
| user@mailsac.com | myemailverifier | invalid | 3.8669 | yes | yes | thread-pool-0_0 | 6.461 |
| user@mailsac.com | reoon | disposable | 3.0198 | yes | yes | thread-pool-0_0 | 5.744 |
| user@mailsac.com | zerobounce | do_not_mail | 0.3632 🏆 | yes | yes | thread-pool-0_0 | 2.930 |
| user@tempr.email | bouncify | undeliverable | 0.6154 | no | yes | thread-pool-0_8 | 181.576 |
| user@tempr.email | captainverify | invalid | 0.5697 | no | no | thread-pool-0_8 | 22.836 |
| user@tempr.email | emaillistverify | unknown | 2.0571 | no | yes | thread-pool-0_8 | 4.208 |
| user@tempr.email | millionverifier | disposable | 0.5481 | no | yes | thread-pool-0_8 | 1.614 |
| user@tempr.email | myemailverifier | invalid | 4.1935 | no | yes | thread-pool-0_8 | 6.461 |
| user@tempr.email | reoon | disposable | 1.0481 | yes | yes | thread-pool-0_8 | 5.744 |
| user@tempr.email | zerobounce | do_not_mail | 0.3356 🏆 | no | yes | thread-pool-0_8 | 2.930 |
| user@yahoo.com | bouncify | accept-all ❌ | 0.7072 | yes | no | thread-pool-0_12 | 181.576 |
| user@yahoo.com | captainverify | invalid ❌ | 0.597 | no | no | thread-pool-0_12 | 22.836 |
| user@yahoo.com | emaillistverify | valid | 1.3502 | yes | no | thread-pool-0_12 | 4.208 |
| user@yahoo.com | millionverifier | unknown ❌ | 0.5145 🏆 | yes | no | thread-pool-0_12 | 1.614 |
| user@yahoo.com | myemailverifier | valid | 3.118 | yes | no | thread-pool-0_12 | 6.461 |
| user@yahoo.com | reoon | valid | 1.1854 | yes | no | thread-pool-0_12 | 5.744 |
| user@yahoo.com | zerobounce | valid | 1.0279 🏆 | yes | no | thread-pool-0_12 | 2.930 |
| xyz@centmil1.com | bouncify | undeliverable | 0.805 | no | no | thread-pool-0_1 | 181.576 |
| xyz@centmil1.com | captainverify | unknown | 21.5099 | no | no | thread-pool-0_1 | 22.836 |
| xyz@centmil1.com | emaillistverify | unknown | 3.1766 | no | no | thread-pool-0_1 | 4.208 |
| xyz@centmil1.com | millionverifier | invalid | 0.4452 | no | no | thread-pool-0_1 | 1.614 |
| xyz@centmil1.com | myemailverifier | invalid | 4.0985 | no | no | thread-pool-0_1 | 6.461 |
| xyz@centmil1.com | reoon | invalid | 0.7275 | no | no | thread-pool-0_1 | 5.744 |
| xyz@centmil1.com | zerobounce | invalid | 0.3171 🏆 | no | no | thread-pool-0_1 | 2.930 |
| xyz@domain1.com | bouncify | undeliverable | 2.0397 | no | no | thread-pool-0_3 | 181.576 |
| xyz@domain1.com | captainverify | invalid | 0.607 | no | no | thread-pool-0_3 | 22.836 |
| xyz@domain1.com | emaillistverify | email_disabled | 1.0901 | no | no | thread-pool-0_3 | 4.208 |
| xyz@domain1.com | millionverifier | invalid | 0.4442 | no | no | thread-pool-0_3 | 1.614 |
| xyz@domain1.com | myemailverifier | invalid | 3.1271 | no | no | thread-pool-0_3 | 6.461 |
| xyz@domain1.com | reoon | invalid | 1.7166 | no | no | thread-pool-0_3 | 5.744 |
| xyz@domain1.com | zerobounce | invalid | 0.3335 🏆 | no | no | thread-pool-0_3 | 2.930 |
Table comparing the JSON field values for each email address across the different Email cleaning service APIs and also compared to local script non-API queries results.
Tested on the same sample emaillist.txt of email addresses. These are their respective returned values for status JSON field which retrieved from the respective API services. While status_code (not used with external APIs), free_email and disposable_email JSON fields are from local script code/databases where applicable. The sub_status is a JSON field only for Zerobounce.
Pay attention to specific email addresses compared for the accuracy of the email verification providers's API results:
user@mailsac.comthis is a known disposable email addressxyz@centmil1.comthis is a domain that doesn't exist so would not have valid DNS or MX DNS recordsuser+to@domain1.comthis is a Google Workspace email address using+user aliasing and is a valid working email addressuser@tempr.emailanother known disposable email addressinfo@domain2.comknown valid Google Workspae email address that is workinguser@gmail.comknown valid Gmail addressop999@gmail.comknown invalid user does not exist Gmail address AFAIKuser@yahoo.comknown valid Yahoo email address that is working
| API | status | sub_status | status_code | free_email | disposable_email | |
|---|---|---|---|---|---|---|
| user@mailsac.com | EmailListVerify | unknown | null | null | yes | yes |
| user@mailsac.com | MillionVerifier | disposable | null | null | false | yes |
| user@mailsac.com | CaptainVerify | risky | null | null | no | yes |
| user@mailsac.com | Proofy.io | undeliverable | null | null | no | yes |
| user@mailsac.com | MyEmailVerifier | invalid | null | null | yes | yes |
| user@mailsac.com | Zerobounce | do_not_mail | disposable | null | yes | yes |
| user@mailsac.com | Reoon | disposable | null | null | yes | yes |
| user@mailsac.com | Bouncify | undeliverable | null | null | yes | yes |
| user@mailsac.com | Bounceless | unknown | unknown | null | yes | yes |
| xyz@centmil1.com | EmailListVerify | unknown | null | null | no | no |
| xyz@centmil1.com | MillionVerifier | invalid | null | null | false | no |
| xyz@centmil1.com | CaptainVerify | invalid | null | null | no | no |
| xyz@centmil1.com | Proofy.io | undeliverable | null | null | no | no |
| xyz@centmil1.com | MyEmailVerifier | invalid | null | null | no | no |
| xyz@centmil1.com | Zerobounce | invalid | no_dns_entries | null | no | no |
| xyz@centmil1.com | Reoon | invalid | null | null | no | no |
| xyz@centmil1.com | Bouncify | undeliverable | null | null | no | no |
| xyz@centmil1.com | Bounceless | no_mx_record | no_mx_record | null | no | no |
| user+to@domain1.com | EmailListVerify | valid | null | null | no | no |
| user+to@domain1.com | MillionVerifier | ok | null | null | false | no |
| user+to@domain1.com | CaptainVerify | valid | null | null | no | no |
| user+to@domain1.com | Proofy.io | deliverable | null | null | no | no |
| user+to@domain1.com | MyEmailVerifier | valid | null | null | no | no |
| user+to@domain1.com | Zerobounce | valid | alias_address | null | no | no |
| user+to@domain1.com | Reoon | valid | null | null | no | no |
| user+to@domain1.com | Bouncify | deliverable | null | null | no | no |
| user+to@domain1.com | Bounceless | Invalid Syntax | Syntax Error | null | no | no |
| xyz@domain1.com | EmailListVerify | email_disabled | null | null | no | no |
| xyz@domain1.com | MillionVerifier | invalid | null | null | false | no |
| xyz@domain1.com | CaptainVerify | invalid | null | null | no | no |
| xyz@domain1.com | Proofy.io | undeliverable | null | null | no | no |
| xyz@domain1.com | MyEmailVerifier | invalid | null | null | no | no |
| xyz@domain1.com | Zerobounce | invalid | mailbox_not_found | null | no | no |
| xyz@domain1.com | Reoon | valid | null | null | no | no |
| xyz@domain1.com | Bouncify | undeliverable | null | null | no | no |
| xyz@domain1.com | Bounceless | unknown | unknown | null | no | no |
| abc@domain1.com | EmailListVerify | email_disabled | null | null | no | no |
| abc@domain1.com | MillionVerifier | invalid | null | null | false | no |
| abc@domain1.com | CaptainVerify | invalid | null | null | no | no |
| abc@domain1.com | Proofy.io | undeliverable | null | null | no | no |
| abc@domain1.com | MyEmailVerifier | invalid | null | null | no | no |
| abc@domain1.com | Zerobounce | invalid | mailbox_not_found | null | no | no |
| abc@domain1.com | Reoon | valid | null | null | no | no |
| abc@domain1.com | Bouncify | undeliverable | null | null | no | no |
| abc@domain1.com | Bounceless | unknown | unknown | null | no | no |
| 123@domain1.com | EmailListVerify | email_disabled | null | null | no | no |
| 123@domain1.com | MillionVerifier | invalid | null | null | false | no |
| 123@domain1.com | CaptainVerify | risky | null | null | no | no |
| 123@domain1.com | Proofy.io | undeliverable | null | null | no | no |
| 123@domain1.com | MyEmailVerifier | invalid | null | null | no | no |
| 123@domain1.com | Zerobounce | invalid | mailbox_not_found | null | no | no |
| 123@domain1.com | Reoon | valid | null | null | no | no |
| 123@domain1.com | Bouncify | undeliverable | null | null | no | no |
| 123@domain1.com | Bounceless | unknown | unknown | null | no | no |
| pop@domain1.com | EmailListVerify | email_disabled | null | null | no | no |
| pop@domain1.com | MillionVerifier | invalid | null | null | false | no |
| pop@domain1.com | CaptainVerify | invalid | null | null | no | no |
| pop@domain1.com | Proofy.io | undeliverable | null | null | no | no |
| pop@domain1.com | MyEmailVerifier | invalid | null | null | no | no |
| pop@domain1.com | Zerobounce | invalid | mailbox_not_found | null | no | no |
| pop@domain1.com | Reoon | valid | null | null | no | no |
| pop@domain1.com | Bouncify | undeliverable | null | null | no | no |
| pop@domain1.com | Bounceless | unknown | unknown | null | no | no |
| pip@domain1.com | EmailListVerify | email_disabled | null | null | no | no |
| pip@domain1.com | MillionVerifier | invalid | null | null | false | no |
| pip@domain1.com | CaptainVerify | invalid | null | null | no | no |
| pip@domain1.com | Proofy.io | undeliverable | null | null | no | no |
| pip@domain1.com | MyEmailVerifier | invalid | null | null | no | no |
| pip@domain1.com | Zerobounce | invalid | mailbox_not_found | null | no | no |
| pip@domain1.com | Reoon | valid | null | null | no | no |
| pip@domain1.com | Bouncify | undeliverable | null | null | no | no |
| pip@domain1.com | Bounceless | unknown | unknown | null | no | no |
| user@tempr.email | EmailListVerify | unknown | null | null | no | yes |
| user@tempr.email | MillionVerifier | disposable | null | null | false | yes |
| user@tempr.email | CaptainVerify | risky | null | null | no | yes |
| user@tempr.email | Proofy.io | undeliverable | null | null | no | yes |
| user@tempr.email | MyEmailVerifier | invalid | null | null | no | yes |
| user@tempr.email | Zerobounce | do_not_mail | disposable | null | no | yes |
| user@tempr.email | Reoon | disposable | null | null | yes | yes |
| user@tempr.email | Bouncify | undeliverable | null | null | no | yes |
| user@tempr.email | Bounceless | invalid | invalid | null | no | yes |
| info@domain2.com | EmailListVerify | valid | null | null | no | no |
| info@domain2.com | MillionVerifier | ok | null | null | false | no |
| info@domain2.com | CaptainVerify | risky | null | null | no | no |
| info@domain2.com | Proofy.io | deliverable | null | null | no | no |
| info@domain2.com | MyEmailVerifier | valid | null | null | no | no |
| info@domain2.com | Zerobounce | do_not_mail | role_based | null | no | no |
| info@domain2.com | Reoon | valid | null | null | no | no |
| info@domain2.com | Bouncify | deliverable | null | null | no | no |
| info@domain2.com | Bounceless | unknown | unknown | null | no | no |
| user@gmail.com | EmailListVerify | valid | null | null | yes | no |
| user@gmail.com | MillionVerifier | ok | null | null | true | no |
| user@gmail.com | CaptainVerify | valid | null | null | yes | no |
| user@gmail.com | Proofy.io | deliverable | null | null | yes | no |
| user@gmail.com | MyEmailVerifier | valid | null | null | yes | no |
| user@gmail.com | Zerobounce | valid | null | yes | no | |
| user@gmail.com | Reoon | valid | null | null | yes | no |
| user@gmail.com | Bouncify | deliverable | null | null | yes | no |
| user@gmail.com | Bounceless | unknown | unknown | null | yes | no |
| op999@gmail.com | EmailListVerify | email_disabled | null | null | yes | no |
| op999@gmail.com | MillionVerifier | invalid | null | null | true | no |
| op999@gmail.com | CaptainVerify | invalid | null | null | yes | no |
| op999@gmail.com | Proofy.io | undeliverable | null | null | no | no |
| op999@gmail.com | MyEmailVerifier | invalid | null | null | yes | no |
| op999@gmail.com | Zerobounce | invalid | mailbox_not_found | null | yes | no |
| op999@gmail.com | Reoon | valid (quick mode) or invalid (power mode) | null | null | yes | no |
| op999@gmail.com | Bouncify | undeliverable | null | null | yes | no |
| op999@gmail.com | Bounceless | unknown | unknown | null | yes | no |
| user@yahoo.com | EmailListVerify | valid | null | null | yes | no |
| user@yahoo.com | MillionVerifier | ok (per email API) or unknown (bulk email API) | null | null | true | no |
| user@yahoo.com | CaptainVerify | unknown | null | null | yes | no |
| user@yahoo.com | Proofy.io | unknown | null | null | no | no |
| user@yahoo.com | MyEmailVerifier | valid | null | null | yes | no |
| user@yahoo.com | Zerobounce | valid | null | yes | no | |
| user@yahoo.com | Reoon | valid | null | null | yes | no |
| user@yahoo.com | Bouncify | accept-all | null | null | yes | no |
| user@yahoo.com | Bounceless | unknown | unknown | null | yes | no |
| user1@outlook.com | EmailListVerify | valid | null | null | yes | no |
| user1@outlook.com | MillionVerifier | ok | null | null | true | no |
| user1@outlook.com | CaptainVerify | valid | null | null | yes | no |
| user1@outlook.com | Proofy.io | deliverable | null | null | yes | no |
| user1@outlook.com | MyEmailVerifier | valid | null | null | yes | no |
| user1@outlook.com | Zerobounce | valid | null | yes | no | |
| user1@outlook.com | Reoon | valid | null | null | yes | no |
| user1@outlook.com | Bouncify | deliverable | null | null | yes | no |
| user1@outlook.com | Bounceless | unknown | unknown | null | yes | no |
| user2@hotmail.com | EmailListVerify | valid | null | null | yes | no |
| user2@hotmail.com | MillionVerifier | ok | null | null | true | no |
| user2@hotmail.com | CaptainVerify | valid | null | null | yes | no |
| user2@hotmail.com | Proofy.io | deliverable | null | null | yes | no |
| user2@hotmail.com | MyEmailVerifier | valid | null | null | yes | no |
| user2@hotmail.com | Zerobounce | valid | null | yes | no | |
| user2@hotmail.com | Reoon | valid | null | null | yes | no |
| user2@hotmail.com | Bouncify | api_error | null | null | yes | no |
| user2@hotmail.com | Bounceless | unknown | unknown | null | yes | no |
First one is EmailListVerify where you set -api emaillistverify -apikey $elvkey where $elvkey is generated API key.
The status field value comes from EmailListVerify API check while free_email and disposable_email field values from from script's own database check. The status_code is null as it's not applicable in -api mode.
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey -v
[
{
"email": "user@mailsac.com",
"status": "unknown",
"status_code": null,
"free_email": "yes",
"disposable_email": "yes"
},
{
"email": "xyz@centmil1.com",
"status": "unknown",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user+to@domain1.com",
"status": "valid",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "xyz@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "abc@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "123@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "pop@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "pip@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@tempr.email",
"status": "unknown",
"status_code": null,
"free_email": "no",
"disposable_email": "yes"
},
{
"email": "info@domain2.com",
"status": "valid",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@gmail.com",
"status": "valid",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "op999@gmail.com",
"status": "email_disabled",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user@yahoo.com",
"status": "valid",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user1@outlook.com",
"status": "valid",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user2@hotmail.com",
"status": "valid",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
}
]
Where EmailListVerify status codes are as follows:
okAll is OK. The server is saying that it is ready to receive a letter to,this address, and no tricks have been detectederrorThe server is saying that delivery failed, but no information about,the email existssmtp_errorThe SMTP answer from the server is invalid or the destination server,reported an internal error to ussmtp_protocolThe destination server allowed us to connect but the SMTP,session was closed before the email was verifiedunknown_emailThe server said that the delivery failed and that the email address does,not existattempt_rejectedThe delivery failed; the reason is similar to “rejected”relay_errorThe delivery failed because a relaying problem took placeantispam_systemSome anti-spam technology is blocking the,verification progressemail_disabledThe email account is suspended, disabled, or limited and can not,receive emailsdomain_errorThe email server for the whole domain is not installed or is,incorrect, so no emails are deliverableok_for_allThe email server is saying that it is ready to accept letters,to any email addressdead_serverThe email server is dead, and no connection to it could be establishedsyntax_errorThere is a syntax error in the email addressunknownThe email delivery failed, but no reason was givenaccept_allThe server is set to accept all emails at a specific domain.,These domains accept any email you send to themdisposableThe email is a temporary address to receive letters and expires,after certain time periodspamtrapThe email address is maintained by an ISP or a third party,which neither clicks nor opens emailsinvalid_mxAn undocumentated status value that isn't in their documentation. As the name implies, invalid MX DNS records
EmailListVerify API integration via -api and apikey arguments combined with Xenforo flags to display the MySQL query to update invalid user's email addresses to email_bounce status in Xenforo database.
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey -xf -xfdb xenforo -xfprefix xf_
[
{
"email": "user@mailsac.com",
"status": "unknown",
"status_code": null,
"free_email": "yes",
"disposable_email": "yes",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';\" xenforo"
},
{
"email": "xyz@centmil1.com",
"status": "unknown",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';\" xenforo"
},
{
"email": "user+to@domain1.com",
"status": "valid",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "xyz@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';\" xenforo"
},
{
"email": "abc@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';\" xenforo"
},
{
"email": "123@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';\" xenforo"
},
{
"email": "pop@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';\" xenforo"
},
{
"email": "pip@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';\" xenforo"
},
{
"email": "user@tempr.email",
"status": "unknown",
"status_code": null,
"free_email": "no",
"disposable_email": "yes",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';\" xenforo"
},
{
"email": "info@domain2.com",
"status": "valid",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@gmail.com",
"status": "valid",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "op999@gmail.com",
"status": "email_disabled",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';\" xenforo"
},
{
"email": "user@yahoo.com",
"status": "valid",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user1@outlook.com",
"status": "valid",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user2@hotmail.com",
"status": "valid",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
}
]
Using jq tool to just filter for MySQL queries.
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey -xf -xfdb xenforo -xfprefix xf_ | jq -r '.[] | select(.xf_sql) | .xf_sql'
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';" xenforo
Looks like Emaillistverify might be correct = unknown for status value. So they differentiate disposable emails = unknown I think regardless of whether the email passes SMTP check. Guess that makes sense, so I should also mark disposable emails so they show xf_sql query
Updated local test code as such to mark disposable_email = yes and display xf_sql query.
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -xf -xfdb xenforo -xfprefix xf_
[
{
"email": "user@mailsac.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "yes",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';\" xenforo"
},
{
"email": "xyz@centmil1.com",
"status": "invalid",
"status_code": null,
"free_email": "unknown",
"disposable_email": "no"
},
{
"email": "user+to@domain1.com",
"status": "ok",
"status_code": 250,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "xyz@domain1.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';\" xenforo"
},
{
"email": "abc@domain1.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';\" xenforo"
},
{
"email": "123@domain1.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';\" xenforo"
},
{
"email": "pop@domain1.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';\" xenforo"
},
{
"email": "pip@domain1.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';\" xenforo"
},
{
"email": "user@tempr.email",
"status": "ok",
"status_code": 250,
"free_email": "no",
"disposable_email": "yes",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';\" xenforo"
},
{
"email": "info@domain2.com",
"status": "ok",
"status_code": 250,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@gmail.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "op999@gmail.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "yes",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';\" xenforo"
},
{
"email": "user@yahoo.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user1@outlook.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user2@hotmail.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "no"
}
]
Added support for EmailListVerify Bulk File API upload with added -apibulk emaillistverify argument. Unfortunately for the below number of emails, the bulk API upload took way longer to process at 45 seconds versus 2.2 seconds for per email verification without -apibulk emaillistverify due to remote processing.
cat email_verification_log_2024-05-05_17-03-01.log
2024-05-05 17:03:02,607 - INFO - File MIME type: text/plain
2024-05-05 17:03:02,607 - INFO - Request data: {'filename': 'emaillist_20240505170302.txt'}
2024-05-05 17:03:02,607 - INFO - File data: {'file_contents': ('emaillist_20240505170302.txt', <_io.BufferedReader name='emaillist.txt'>, 'text/plain')}
2024-05-05 17:03:03,293 - INFO - File uploaded successfully. File ID: 2400498
2024-05-05 17:03:03,832 - INFO - File processing in progress. Status: progress
2024-05-05 17:03:09,420 - INFO - File processing in progress. Status: progress
2024-05-05 17:03:14,883 - INFO - File processing in progress. Status: progress
2024-05-05 17:03:20,148 - INFO - File processing in progress. Status: progress
2024-05-05 17:03:25,334 - INFO - File processing in progress. Status: progress
2024-05-05 17:03:30,533 - INFO - File processing in progress. Status: progress
2024-05-05 17:03:35,801 - INFO - File processing in progress. Status: progress
2024-05-05 17:03:41,075 - INFO - File processing in progress. Status: progress
2024-05-05 17:03:46,421 - INFO - File processing completed. Retrieving results from: https://files-elv.s3.eu-central-1.amazonaws.com/2024-05/276e5d9b771214ca9e5e6b59f67b481bfa0a2fabc_all.csv
2024-05-05 17:03:46,783 - INFO - Results file downloaded: emaillistverify_results_1714928583.csv
2024-05-05 17:03:46,784 - INFO - Results retrieved successfully. Total lines: 15
with -apibulk emaillistverify argument
python validate_emails.py -f user@domain1.com -l emaillist.txt -api emaillistverify -apikey $elvkey -apibulk emaillistverify -tm all
[
{
"email": "user@mailsac.com",
"status": "disposable",
"status_code": "",
"free_email": "yes",
"disposable_email": "yes"
},
{
"email": "xyz@centmil1.com",
"status": "dead_server",
"status_code": "",
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user+to@domain1.com",
"status": "valid",
"status_code": "",
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@tempr.email",
"status": "disposable",
"status_code": "",
"free_email": "no",
"disposable_email": "yes"
},
{
"email": "info@domain2.com",
"status": "valid",
"status_code": "",
"free_email": "no",
"disposable_email": "no"
},
{
"email": "xyz@domain1.com",
"status": "email_disabled",
"status_code": "",
"free_email": "no",
"disposable_email": "no"
},
{
"email": "abc@domain1.com",
"status": "email_disabled",
"status_code": "",
"free_email": "no",
"disposable_email": "no"
},
{
"email": "123@domain1.com",
"status": "email_disabled",
"status_code": "",
"free_email": "no",
"disposable_email": "no"
},
{
"email": "pop@domain1.com",
"status": "email_disabled",
"status_code": "",
"free_email": "no",
"disposable_email": "no"
},
{
"email": "pip@domain1.com",
"status": "email_disabled",
"status_code": "",
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@gmail.com",
"status": "valid",
"status_code": "",
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "op999@gmail.com",
"status": "email_disabled",
"status_code": "",
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user@yahoo.com",
"status": "valid",
"status_code": "",
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user1@outlook.com",
"status": "valid",
"status_code": "",
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user2@hotmail.com",
"status": "valid",
"status_code": "",
"free_email": "yes",
"disposable_email": "no"
}
]
Add MillionVerifier API support
Manual email test via their dashboard reveals
"email","quality","result","free","role"
"user@mailsac.com","bad","disposable","no","yes"
"xyz@centmil1.com","bad","invalid","no","no"
"user+to@domain1.com","good","ok","no","no"
"user@tempr.email","bad","disposable","no","yes"
"info@domain2.com","good","ok","no","yes"
"xyz@domain1.com","bad","invalid","no","no"
"abc@domain1.com","bad","invalid","no","yes"
"123@domain1.com","bad","invalid","no","no"
"pop@domain1.com","bad","invalid","no","no"
"pip@domain1.com","bad","invalid","no","no"
"user@gmail.com","good","ok","yes","no"
"op999@gmail.com","bad","invalid","yes","no"
"user@yahoo.com","good","ok","yes","no"
"user1@outlook.com","good","ok","yes","no"
"user2@hotmail.com","good","ok","yes","no"
MillionVerifier API enabled run -api millionverifier -apikey_mv $mvkey
Also updated code to retrive API results for free_email_api and role_api while free_email and disposable_email are local script database lookup based
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey
[
{
"email": "user@mailsac.com",
"status": "disposable",
"status_code": null,
"free_email": "yes",
"disposable_email": "yes",
"free_email_api": false,
"role_api": true
},
{
"email": "xyz@centmil1.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": false,
"role_api": false
},
{
"email": "user+to@domain1.com",
"status": "ok",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": false,
"role_api": false
},
{
"email": "xyz@domain1.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": false,
"role_api": false
},
{
"email": "abc@domain1.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": false,
"role_api": true
},
{
"email": "123@domain1.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": false,
"role_api": false
},
{
"email": "pop@domain1.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": false,
"role_api": false
},
{
"email": "pip@domain1.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": false,
"role_api": false
},
{
"email": "user@tempr.email",
"status": "disposable",
"status_code": null,
"free_email": "no",
"disposable_email": "yes",
"free_email_api": false,
"role_api": true
},
{
"email": "info@domain2.com",
"status": "ok",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": false,
"role_api": true
},
{
"email": "user@gmail.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": true,
"role_api": false
},
{
"email": "op999@gmail.com",
"status": "invalid",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": true,
"role_api": false
},
{
"email": "user@yahoo.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": true,
"role_api": false
},
{
"email": "user1@outlook.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": true,
"role_api": false
},
{
"email": "user2@hotmail.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": true,
"role_api": false
}
]
MillionVerifier API enabled run with -xf -xfdb xenforo -xfprefix xf_ flags
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey -xf -xfdb xenforo -xfprefix xf_
[
{
"email": "user@mailsac.com",
"status": "disposable",
"status_code": null,
"free_email": "yes",
"disposable_email": "yes",
"free_email_api": false,
"role_api": true,
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';\" xenforo"
},
{
"email": "xyz@centmil1.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": false,
"role_api": false,
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';\" xenforo"
},
{
"email": "user+to@domain1.com",
"status": "ok",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": false,
"role_api": false
},
{
"email": "xyz@domain1.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": false,
"role_api": false,
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';\" xenforo"
},
{
"email": "abc@domain1.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": false,
"role_api": true,
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';\" xenforo"
},
{
"email": "123@domain1.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": false,
"role_api": false,
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';\" xenforo"
},
{
"email": "pop@domain1.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": false,
"role_api": false,
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';\" xenforo"
},
{
"email": "pip@domain1.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": false,
"role_api": false,
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';\" xenforo"
},
{
"email": "user@tempr.email",
"status": "disposable",
"status_code": null,
"free_email": "no",
"disposable_email": "yes",
"free_email_api": false,
"role_api": true,
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';\" xenforo"
},
{
"email": "info@domain2.com",
"status": "ok",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": false,
"role_api": true
},
{
"email": "user@gmail.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": true,
"role_api": false
},
{
"email": "op999@gmail.com",
"status": "invalid",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": true,
"role_api": false,
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';\" xenforo"
},
{
"email": "user@yahoo.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": true,
"role_api": false
},
{
"email": "user1@outlook.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": true,
"role_api": false
},
{
"email": "user2@hotmail.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": true,
"role_api": false
}
]
jq filterd for Xenforo MySQL queries only
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey -xf -xfdb xenforo -xfprefix xf_ | jq -r '.[] | select(.xf_sql) | .xf_sql'
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';" xenforo
Added support for MillionVerifier Bulk File API upload with added -apibulk millionverifier argument. Unfortunately for the below number of emails, the bulk API upload took a bit longer to process at 7 seconds versus 2.2 seconds for per email verification without -apibulk millionverifier due to remote processing.
cat email_verification_log_2024-05-06_05-36-30.log
2024-05-06 05:36:31,484 - INFO - Uploading file: emaillist.txt
2024-05-06 05:36:31,484 - INFO - Request URL: https://bulkapi.millionverifier.com/bulkapi/v2/upload?key=APIKEY&remove_duplicates=1
2024-05-06 05:36:31,484 - INFO - Request data: {'key': 'APIKEY'}
2024-05-06 05:36:31,484 - INFO - Request files: {'file_contents': <_io.BufferedReader name='emaillist.txt'>}
2024-05-06 05:36:31,765 - INFO - Response status code: 200
2024-05-06 05:36:31,765 - INFO - Response content: {
"file_id": "26458323",
"file_name": "emaillist.txt",
"status": "unknown",
"unique_emails": 0,
"updated_at": "2024-05-06 05:36:31",
"createdate": "2024-05-06 05:36:31",
"percent": 0,
"total_rows": 0,
"verified": 0,
"unverified": 0,
"ok": 0,
"catch_all": 0,
"disposable": 0,
"invalid": 0,
"unknown": 0,
"reverify": 0,
"credit": 0,
"estimated_time_sec": 0,
"error": ""
}
2024-05-06 05:36:31,765 - INFO - Response JSON: {'file_id': '26458323', 'file_name': 'emaillist.txt', 'status': 'unknown', 'unique_emails': 0, 'updated_at': '2024-05-06 05:36:31', 'createdate': '2024-05-06 05:36:31', 'percent': 0, 'total_rows': 0, 'verified': 0, 'unverified': 0, 'ok': 0, 'catch_all': 0, 'disposable': 0, 'invalid': 0, 'unknown': 0, 'reverify': 0, 'credit': 0, 'estimated_time_sec': 0, 'error': ''}
2024-05-06 05:36:31,765 - INFO - File uploaded successfully. File ID: 26458323
2024-05-06 05:36:32,046 - INFO - File processing in progress. Progress: 0%
2024-05-06 05:36:37,328 - INFO - File processing completed. Retrieving results.
2024-05-06 05:36:37,607 - INFO - Results file downloaded: millionverifier_results_20240506053637.csv
2024-05-06 05:36:37,608 - INFO - Results retrieved successfully. Total lines: 15
with -apibulk millionverifier argument
Also updated code to retrive API results for free_email_api and role_api while free_email and disposable_email are local script database lookup based
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey -apibulk millionverifier
[
{
"email": "user@mailsac.com",
"status": "disposable",
"free_email": "yes",
"disposable_email": "yes",
"free_email_api": "no",
"role_api": "yes"
},
{
"email": "xyz@centmil1.com",
"status": "invalid",
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no",
"role_api": "no"
},
{
"email": "user+to@domain1.com",
"status": "ok",
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no",
"role_api": "no"
},
{
"email": "user@tempr.email",
"status": "disposable",
"free_email": "no",
"disposable_email": "yes",
"free_email_api": "no",
"role_api": "yes"
},
{
"email": "info@domain2.com",
"status": "ok",
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no",
"role_api": "yes"
},
{
"email": "xyz@domain1.com",
"status": "invalid",
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no",
"role_api": "no"
},
{
"email": "abc@domain1.com",
"status": "invalid",
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no",
"role_api": "yes"
},
{
"email": "123@domain1.com",
"status": "invalid",
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no",
"role_api": "no"
},
{
"email": "pop@domain1.com",
"status": "invalid",
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no",
"role_api": "no"
},
{
"email": "pip@domain1.com",
"status": "invalid",
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no",
"role_api": "no"
},
{
"email": "user@gmail.com",
"status": "ok",
"free_email": "yes",
"disposable_email": "no",
"free_email_api": "yes",
"role_api": "no"
},
{
"email": "op999@gmail.com",
"status": "invalid",
"free_email": "yes",
"disposable_email": "no",
"free_email_api": "yes",
"role_api": "no"
},
{
"email": "user@yahoo.com",
"status": "unknown",
"free_email": "yes",
"disposable_email": "no",
"free_email_api": "yes",
"role_api": "no"
},
{
"email": "user1@outlook.com",
"status": "ok",
"free_email": "yes",
"disposable_email": "no",
"free_email_api": "yes",
"role_api": "no"
},
{
"email": "user2@hotmail.com",
"status": "ok",
"free_email": "yes",
"disposable_email": "no",
"free_email_api": "yes",
"role_api": "no"
}
]
without -apibulk millionverifier argument for per email checks
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey
[
{
"email": "user@mailsac.com",
"status": "disposable",
"status_code": null,
"free_email": "yes",
"disposable_email": "yes",
"free_email_api": false,
"role_api": true
},
{
"email": "xyz@centmil1.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": false,
"role_api": false
},
{
"email": "user+to@domain1.com",
"status": "ok",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": false,
"role_api": false
},
{
"email": "xyz@domain1.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": false,
"role_api": false
},
{
"email": "abc@domain1.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": false,
"role_api": true
},
{
"email": "123@domain1.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": false,
"role_api": false
},
{
"email": "pop@domain1.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": false,
"role_api": false
},
{
"email": "pip@domain1.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": false,
"role_api": false
},
{
"email": "user@tempr.email",
"status": "disposable",
"status_code": null,
"free_email": "no",
"disposable_email": "yes",
"free_email_api": false,
"role_api": true
},
{
"email": "info@domain2.com",
"status": "ok",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": false,
"role_api": true
},
{
"email": "user@gmail.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": true,
"role_api": false
},
{
"email": "op999@gmail.com",
"status": "invalid",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": true,
"role_api": false
},
{
"email": "user@yahoo.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": true,
"role_api": false
},
{
"email": "user1@outlook.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": true,
"role_api": false
},
{
"email": "user2@hotmail.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": true,
"role_api": false
}
]
Noticed for below sample 15 email addresses tested, I always got 1 refunded credit so it applies to one email address which is a known valid email user@yahoo.com which is classed as unknown in bulk API but classed as ok in per email verification API. They refund credits for emails classified as 'risky' (catch_all or unknown) https://help.millionverifier.com/payments-credits/refund-for-risky-emails. Seems to be a bug in their bulk API then as the refunds only apply to bulk API and not per email verification checks due to differences in classifications in bulk API vs per email verification API.
I reached out to MillionVerifier chat support which was initially handled via Milly their AI chat bot which later referred me to support. They emailed me back saying:
We're glad you reached out to us about this issue, and we're here to help. The discrepancy you're seeing in the results is likely because we were unable to connect to the server during the verification process, leading to an "Unknown" result. However, for the single API, the connection went through smoothly, allowing us to verify the email without any problems. An "Unknown" result simply means that we couldn't determine the existence of the email at the time of verification. If you have any more questions, queries, or issues, we're more than happy to assist.
I tried a few attempts at bulk API for the same list of 15 emails, and user@yahoo.com is always marked as status = unknown and never anything different though? It would be hard to differentiate status classifications if it's due connection issues if they're lumped into other emails in unknown label. Maybe would be better to have a separate classification for connection issues so we can differentiate as such. For example, EmailListVerify has 18 different status classifications including for connection related issues.
single email API check for user@yahoo.com returns ok
python validate_emails.py -f user@domain1.com -e user@yahoo.com -api millionverifier -apikey_mv $mvkey -tm all
[
{
"email": "user@yahoo.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": true,
"role_api": false
}
]
bulk API upload check excerpt for user@yahoo.com returns unknown
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey -apibulk millionverifier
[
{
"email": "user@yahoo.com",
"status": "unknown",
"free_email": "yes",
"disposable_email": "no",
"free_email_api": "yes",
"role_api": "no"
},
]
As such you can't 100% rely on the status output to do tasks like updating Xenforo user's user_state status to stop sending emails to them without further verification for such emails. For now, I've updated my validate_emails.py script for MillionVerifier bulk API and per email check API results, to not list Xenforo SQL queries for unknown status results and only list Xenforo SQL queries for invalid and disposable status emails. Same can be said for other providers, probably need to really double check your results if you're relying on the results for important tasks. You can filter MillionVerifier's unknown status emails and feed them into another commercial provider's API to double check i.e. EmailListVerify or use script's self-hosted local email check. Given cheaper MillionVerifier pricing, it might be more economical to do it this way?
MillionVerifier bulk API filter -api millionverifier -apikey_mv $mvkey -apibulk millionverifier filter using jq for unknown status emails piped into text file results-millionverifier-bulk-api-unknown-only.txt
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey -apibulk millionverifier | jq '.[] | select(.status == "unknown")' 2>&1 > results-millionverifier-bulk-api-unknown-only.txt
The results-millionverifier-bulk-api-unknown-only.txt contents will show all MillionVerifier bulk API returned unknown status results.
cat results-millionverifier-bulk-api-unknown-only.txt
{
"email": "user@yahoo.com",
"status": "unknown",
"free_email": "yes",
"disposable_email": "no",
"free_email_api": "yes",
"role_api": "no"
}
Using same results-millionverifier-bulk-api-unknown-only.txt file, and jq just filter out the email addresses into a new results-millionverifier-bulk-api-unknown-only-emails.txt file
cat results-millionverifier-bulk-api-unknown-only.txt | jq -r '.email' | tee results-millionverifier-bulk-api-unknown-only-emails.txt
user@yahoo.com
Then use EmailListVerify bulk API to verify the filtered MillionVerifier unknown status list filtered file results-millionverifier-bulk-api-unknown-only-emails.txt and double check the status which confirms it's actually a valid email.
python validate_emails.py -f user@domain1.com -l results-millionverifier-bulk-api-unknown-only-emails.txt -tm all -api emaillistverify -apikey $elvkey -apibulk emaillistverify
[
{
"email": "user@yahoo.com",
"status": "valid",
"status_code": "",
"free_email": "yes",
"disposable_email": "no"
}
]
Or EmailListVerify per email verification API check
./validate_emails.py -f user@domain1.com -e user@yahoo.com -tm all -api emaillistverify -apikey $elvkey -tm all
[
{
"email": "user@yahoo.com",
"status": "valid",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
}
]
Or if it's a few emails, via validate_emails.py script's self-hosted local email syntax, DNS and SMTP check
validate_emails.py -f user@domain1.com -e user@yahoo.com -tm all
[
{
"email": "user@yahoo.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "no"
}
]
Add CaptainVerify API support.
CaptainVerify's API has rate limits, as such script needed to add such to it's routines.
The API is limited to a maximum of 2 simultaneous connections and 50 checks per minute. When integrating the API, make sure your application does not exceed this limit.
The update_captainverify_rate_limit function is responsible for managing the rate limiting of requests to the CaptainVerify API. It ensures that the script complies with the API's rate limits of a maximum of 2 simultaneous connections and 50 checks per minute.
The purpose of the update_captainverify_rate_limit function is to coordinate access to the CaptainVerify API across multiple processes and prevent exceeding the API's rate limits. It achieves this by using a shared file (captainverify_rate_limit.json) to store and update the rate limiting information.
The update_captainverify_rate_limit function performs the following steps:
- It takes a
lock_fileparameter, which specifies the path to the file used for storing the rate limiting information. - It opens the
lock_filein read and write mode ('r+') to allow reading from and writing to the file. - It acquires an exclusive lock on the file using the
fcntl.flockfunction with thefcntl.LOCK_EXflag. This ensures that only one process can access and modify the file at a time, preventing race conditions. - It reads the existing rate limiting data from the file using
json.load. The rate limiting data includes the timestamp of the last request (last_request_time) and the count of requests made within the current minute (request_count). - It calculates the elapsed time since the last request by subtracting
last_request_timefrom the current time. - If the elapsed time is less than 60 seconds (indicating that the current minute has not passed), it increments the
request_countby 1. - If the
request_countexceeds 50 (the maximum allowed requests per minute), it calculates the remaining time until the current minute completes and sleeps for that duration usingtime.sleep. After sleeping, it updateslast_request_timeto the current time and resetsrequest_countto 1. - If the elapsed time is greater than or equal to 60 seconds (indicating that a new minute has started), it updates
last_request_timeto the current time and resetsrequest_countto 1. - It updates the
last_request_timeandrequest_countvalues in thedatadictionary. - It seeks to the beginning of the file using
file.seek(0), writes the updateddatadictionary to the file usingjson.dump, and truncates any remaining content in the file usingfile.truncate(). This ensures that the file contains only the updated rate limiting data. - It releases the exclusive lock on the file using
fcntl.flockwith thefcntl.LOCK_UNflag, allowing other processes to access the file.
The update_captainverify_rate_limit function is called within the validate_and_classify function whenever an email verification request is made to the CaptainVerify API (i.e., when args.api == 'captainverify' and args.test_mode == 'all').
By calling update_captainverify_rate_limit before making the API request, the script ensures that the rate limiting information is updated and that the API's rate limits are respected across multiple processes.
The lock_file parameter specifies the path to the file used for storing the rate limiting information. In the provided code, the file is named 'captainverify_rate_limit.json' and is initialized in the main function.
Manual email test via their dashboard reveals
email;status;free;disposable;role;ok_for_all;protected;did_you_mean;details
user@mailsac.com;risky;0;1;1;1;0;;low quality
xyz@centmil1.com;invalid;0;0;0;0;0;;smtp error
user+to@domain1.com;ok;0;0;0;0;0;;
user@tempr.email;risky;0;1;1;1;0;;low quality
info@domain2.com;risky;0;0;1;0;0;;low quality
xyz@domain1.com;invalid;0;0;0;0;0;;email error
abc@domain1.com;invalid;0;0;1;0;0;;email error
123@domain1.com;invalid;0;0;1;0;0;;email error
pop@domain1.com;invalid;0;0;0;0;0;;email error
pip@domain1.com;invalid;0;0;0;0;0;;email error
user@gmail.com;ok;1;0;0;0;0;;
op999@gmail.com;invalid;1;0;0;0;0;;email error
user@yahoo.com;unknown;1;0;0;0;0;;
user1@outlook.com;ok;1;0;0;0;0;;
user2@hotmail.com;ok;1;0;0;0;0;;
CaptainVerify API enabled run -api captainverify -apikey_cv $cvkey
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api captainverify -apikey_cv $cvkey -xf -xfdb xenforo -xfprefix xf_
[
{
"email": "user@mailsac.com",
"status": "risky",
"status_code": null,
"free_email": "no",
"disposable_email": "yes",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';\" xenforo"
},
{
"email": "xyz@centmil1.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';\" xenforo"
},
{
"email": "user+to@domain1.com",
"status": "valid",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "xyz@domain1.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';\" xenforo"
},
{
"email": "abc@domain1.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';\" xenforo"
},
{
"email": "123@domain1.com",
"status": "risky",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';\" xenforo"
},
{
"email": "pop@domain1.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';\" xenforo"
},
{
"email": "pip@domain1.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';\" xenforo"
},
{
"email": "user@tempr.email",
"status": "risky",
"status_code": null,
"free_email": "no",
"disposable_email": "yes",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';\" xenforo"
},
{
"email": "info@domain2.com",
"status": "risky",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'info@domain2.com';\" xenforo"
},
{
"email": "user@gmail.com",
"status": "valid",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "op999@gmail.com",
"status": "invalid",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';\" xenforo"
},
{
"email": "user@yahoo.com",
"status": "unknown",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@yahoo.com';\" xenforo"
},
{
"email": "user1@outlook.com",
"status": "valid",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user2@hotmail.com",
"status": "valid",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
}
]
jq filterd for Xenforo MySQL queries only
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api captainverify -apikey_cv $cvkey -xf -xfdb xenforo -xfprefix xf_ | jq -r '.[] | select(.xf_sql) | .xf_sql'
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'info@domain2.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@yahoo.com';" xenforo
Add Proofy.io API support
Proofy.io API enabled run -api proofy -apikey_pf $pkey -apiuser_pf $puser
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api proofy -apikey_pf $pkey -apiuser_pf $puser -xf -xfdb xenforo -xfprefix xf_
[
{
"email": "user@mailsac.com",
"status": "undeliverable",
"status_code": null,
"free_email": "no",
"disposable_email": "yes",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';\" xenforo"
},
{
"email": "xyz@centmil1.com",
"status": "undeliverable",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';\" xenforo"
},
{
"email": "user+to@domain1.com",
"status": "deliverable",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "xyz@domain1.com",
"status": "undeliverable",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';\" xenforo"
},
{
"email": "abc@domain1.com",
"status": "undeliverable",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';\" xenforo"
},
{
"email": "123@domain1.com",
"status": "undeliverable",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';\" xenforo"
},
{
"email": "pop@domain1.com",
"status": "undeliverable",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';\" xenforo"
},
{
"email": "pip@domain1.com",
"status": "undeliverable",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';\" xenforo"
},
{
"email": "user@tempr.email",
"status": "undeliverable",
"status_code": null,
"free_email": "no",
"disposable_email": "yes",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';\" xenforo"
},
{
"email": "info@domain2.com",
"status": "deliverable",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@gmail.com",
"status": "deliverable",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "op999@gmail.com",
"status": "undeliverable",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';\" xenforo"
},
{
"email": "user@yahoo.com",
"status": "unknown",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@yahoo.com';\" xenforo"
},
{
"email": "user1@outlook.com",
"status": "deliverable",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user2@hotmail.com",
"status": "deliverable",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
}
]
Unfortunately, Proofy.io has a stricter max concurrent connection limit so will slow down processing of email verifications. Proofy.io API limits mean email verifications are at least 2x or more slower. As such need to add a -pf_max_connections parameter which set to 1 by default when argument not passed on command line like above. But even with -pf_max_connections 2 Proofy.io API complains and email status = api_error occur.
From email_verification_log_2024-05-05_14-06-36.log
2024-05-05 14:07:08,450 - ERROR - Unexpected API response for user2@hotmail.com: {'error': True, 'message': 'You already use the maximum number of simultaneous connections. Try this request later.'}
2024-05-05 14:07:08,450 - ERROR - Max retries exceeded for user2@hotmail.com. Skipping
Testing Proofy.io, ran out of credits from log email_verification_log_2024-05-05_14-20-50.log
2024-05-05 14:21:35,810 - ERROR - Unexpected API response for user2@hotmail.com: {'error': True, 'message': "You don't have checks. Check your balance."}
2024-05-05 14:21:46,461 - ERROR - Max retries exceeded for user2@hotmail.com. Skipping.
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api proofy -apikey_pf $pkey -apiuser_pf $puser -xf -xfdb xenforo -xfprefix xf_ -pf_max_connections 2
[
{
"email": "user@mailsac.com",
"status": "api_error",
"status_code": null,
"free_email": "unknown",
"disposable_email": "unknown"
},
{
"email": "xyz@centmil1.com",
"status": "api_error",
"status_code": null,
"free_email": "unknown",
"disposable_email": "unknown"
},
{
"email": "user+to@domain1.com",
"status": "api_error",
"status_code": null,
"free_email": "unknown",
"disposable_email": "unknown"
},
{
"email": "xyz@domain1.com",
"status": "api_error",
"status_code": null,
"free_email": "unknown",
"disposable_email": "unknown"
},
{
"email": "abc@domain1.com",
"status": "api_error",
"status_code": null,
"free_email": "unknown",
"disposable_email": "unknown"
},
{
"email": "123@domain1.com",
"status": "api_error",
"status_code": null,
"free_email": "unknown",
"disposable_email": "unknown"
},
{
"email": "pop@domain1.com",
"status": "api_error",
"status_code": null,
"free_email": "unknown",
"disposable_email": "unknown"
},
{
"email": "pip@domain1.com",
"status": "api_error",
"status_code": null,
"free_email": "unknown",
"disposable_email": "unknown"
},
{
"email": "user@tempr.email",
"status": "api_error",
"status_code": null,
"free_email": "unknown",
"disposable_email": "unknown"
},
{
"email": "info@domain2.com",
"status": "api_error",
"status_code": null,
"free_email": "unknown",
"disposable_email": "unknown"
},
{
"email": "user@gmail.com",
"status": "api_error",
"status_code": null,
"free_email": "unknown",
"disposable_email": "unknown"
},
{
"email": "op999@gmail.com",
"status": "api_error",
"status_code": null,
"free_email": "unknown",
"disposable_email": "unknown"
},
{
"email": "user@yahoo.com",
"status": "api_error",
"status_code": null,
"free_email": "unknown",
"disposable_email": "unknown"
},
{
"email": "user1@outlook.com",
"status": "api_error",
"status_code": null,
"free_email": "unknown",
"disposable_email": "unknown"
},
{
"email": "user2@hotmail.com",
"status": "api_error",
"status_code": null,
"free_email": "unknown",
"disposable_email": "unknown"
}
]
jq filterd for Xenforo MySQL queries only
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api proofy -apikey_pf $pkey -apiuser_pf $puser -xf -xfdb xenforo -xfprefix xf_ | jq -r '.[] | select(.xf_sql) | .xf_sql'
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'info@domain2.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@yahoo.com';" xenforo
Add MyEmailVerifier API support
MyEmailVerifier API enabled run -api myemailverifier -apikey_mev $mevkey
python validate_emails.py -f user@domain1.com -l emaillist.txt -api myemailverifier -apikey_mev $mevkey -tm all
[
{
"email": "user@mailsac.com",
"status": "invalid",
"status_code": null,
"free_email": "yes",
"disposable_email": "yes"
},
{
"email": "xyz@centmil1.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user+to@domain1.com",
"status": "valid",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "xyz@domain1.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "abc@domain1.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "123@domain1.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "pop@domain1.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "pip@domain1.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@tempr.email",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "yes"
},
{
"email": "info@domain2.com",
"status": "valid",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@gmail.com",
"status": "valid",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "op999@gmail.com",
"status": "invalid",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user@yahoo.com",
"status": "valid",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user1@outlook.com",
"status": "valid",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user2@hotmail.com",
"status": "valid",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
}
]
jq filterd for Xenforo MySQL queries only
python validate_emails.py -f user@domain1.com -l emaillist.txt -api myemailverifier -apikey_mev $mevkey -tm all -xf -xfdb xenforo -xfprefix xf_ | jq -r '.[] | select(.xf_sql) | .xf_sql'
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';" xenforo
Add Zerobounce API support
Zerobounce API enabled run -api zerobounce -apikey_zb $zbkey -tm all with specified email address -e hnyfmw@canadlan-drugs.com. The status, sub_status and free_email_api JSON fields are from API and free_email and disposable_email JSON fields are from local script database checks.
python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api zerobounce -apikey_zb $zbkey
[
{
"email": "hnyfmw@canadlan-drugs.com",
"status": "invalid",
"sub_status": "no_dns_entries",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no"
}
]
For email per verification API check for list of emails in emaillist.txt via -l emaillist.txt. The status, sub_status and free_email_api JSON fields are from API and free_email and disposable_email JSON fields are from local script database checks.
time python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api zerobounce -apikey_zb $zbkey
[
{
"email": "user@mailsac.com",
"status": "do_not_mail",
"sub_status": "disposable",
"status_code": null,
"free_email": "yes",
"disposable_email": "yes",
"free_email_api": "yes"
},
{
"email": "xyz@centmil1.com",
"status": "invalid",
"sub_status": "no_dns_entries",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no"
},
{
"email": "user+to@domain1.com",
"status": "valid",
"sub_status": "alias_address",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no"
},
{
"email": "xyz@domain1.com",
"status": "invalid",
"sub_status": "mailbox_not_found",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no"
},
{
"email": "abc@domain1.com",
"status": "invalid",
"sub_status": "mailbox_not_found",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no"
},
{
"email": "123@domain1.com",
"status": "invalid",
"sub_status": "mailbox_not_found",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no"
},
{
"email": "pop@domain1.com",
"status": "invalid",
"sub_status": "mailbox_not_found",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no"
},
{
"email": "pip@domain1.com",
"status": "invalid",
"sub_status": "mailbox_not_found",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no"
},
{
"email": "user@tempr.email",
"status": "do_not_mail",
"sub_status": "disposable",
"status_code": null,
"free_email": "no",
"disposable_email": "yes",
"free_email_api": "yes"
},
{
"email": "info@domain2.com",
"status": "do_not_mail",
"sub_status": "role_based",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no"
},
{
"email": "user@gmail.com",
"status": "valid",
"sub_status": "",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": "yes"
},
{
"email": "op999@gmail.com",
"status": "invalid",
"sub_status": "mailbox_not_found",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": "yes"
},
{
"email": "user@yahoo.com",
"status": "valid",
"sub_status": "",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": "yes"
},
{
"email": "user1@outlook.com",
"status": "valid",
"sub_status": "",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": "yes"
},
{
"email": "user2@hotmail.com",
"status": "valid",
"sub_status": "",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": "yes"
}
]
real 0m4.794s
user 0m2.218s
sys 0m0.065s
Test ZeroBounce per email check API -api zerobounce -apikey_zb $zbkey with Cloudflare Cache -apicache zerobounce -apicachettl 900
time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api zerobounce -apikey_zb $zbkey -tm all -apicache zerobounce -apicachettl 900
[
{
"email": "hnyfmw@canadlan-drugs.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
}
]
real 0m0.777s
user 0m0.253s
sys 0m0.034s
Log inspection
cat $(ls -Art | tail -3 | grep 'email_verification')
2024-05-11 11:28:05,131 - INFO - Cache result: {'address': 'hnyfmw@canadlan-drugs.com', 'status': 'invalid', 'sub_status': 'no_dns_entries', 'free_email': False, 'did_you_mean': None, 'account': 'hnyfmw', 'domain': 'canadlan-drugs.com', 'domain_age_days': '2026', 'smtp_provider': '', 'mx_found': 'false', 'mx_record': '', 'firstname': None, 'lastname': None, 'gender': None, 'country': None, 'region': None, 'city': None, 'zipcode': None, 'processed_at': '2024-05-11 10:37:39.035'}
Cloudflare KV storage entries
| Key | Value |
|---|---|
| zerobounce:hnyfmw@canadlan-drugs.com | {"result":{"address":"hnyfmw@canadlan-drugs.com","status":"invalid","sub_status":"no_dns_entries","free_email":false,"did_you_mean":null,"account":"hnyfmw","domain":"canadlan-drugs.com","domain_age_days":"2026","smtp_provider":"","mx_found":"false","mx_record":"","firstname":null,"lastname":null,"gender":null,"country":null,"region":null,"city":null,"zipcode":null,"processed_at":"2024-05-11 11:39:24.133"},"timestamp":1715427564270,"ttl":900} |
Test Cloudflare R2 storage via -store r2 to save email verification results to Cloudflare R2 bucket directory at emailapi-zerobounce-cached/output_20240511122039.json
time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api zerobounce -apikey_zb $zbkey -tm all -apicache zerobounce -apicachettl 900 -store r2
Output stored successfully in R2: emailapi-zerobounce-cached/output_20240511122039.json
[
{
"email": "hnyfmw@canadlan-drugs.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
}
]
real 0m1.210s
user 0m0.355s
sys 0m0.031s
Add Reoon API support
Reoon API enabled run -api reoon -apikey_rn $reokey -tm all with specified email address -e hnyfmw@canadlan-drugs.com. The status, role_account, mx_accepts_mail, spamtrap, mx_records, overall_score, safe_to_send, can_connect_smtp, inbox_full, catch_all, deliverable, disabled JSON field is from API and free_email and disposable_email JSON fields are from local script database checks.
Reoon has 2 modes for single email verification API which can be set via -reoon_mode to a value of either quick or power. The default mode without -reoon_mode being set is quick.
time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api reoon -apikey_rn $reokey
[
{
"email": "hnyfmw@canadlan-drugs.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "yes",
"role_account": "no",
"mx_accepts_mail": "no",
"spamtrap": "no",
"mx_records": null,
"verification_mode": "quick",
"overall_score": null,
"safe_to_send": null,
"can_connect_smtp": null,
"inbox_full": null,
"catch_all": null,
"deliverable": null,
"disabled": null
}
]
real 0m3.748s
user 0m0.358s
sys 0m0.028s
With -reoon_mode power. Currently, script hasn't been configured to grab the additional information provided by power mode.
time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api reoon -apikey_rn $reokey -reoon_mode power
[
{
"email": "hnyfmw@canadlan-drugs.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "yes",
"role_account": "no",
"mx_accepts_mail": "no",
"spamtrap": "no",
"mx_records": [],
"verification_mode": "power",
"overall_score": 0,
"safe_to_send": "no",
"can_connect_smtp": "no",
"inbox_full": "no",
"catch_all": "no",
"deliverable": "no",
"disabled": "no"
}
]
real 0m3.196s
user 0m0.360s
sys 0m0.026s
For email per verification API check for list of emails in emaillist.txt via -l emaillist.txt. The status JSON field is from API and free_email and disposable_email JSON fields are from local script database checks.
time python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api reoon -apikey_rn $reokey
[
{
"email": "user@mailsac.com",
"status": "disposable",
"status_code": null,
"free_email": "yes",
"disposable_email": "yes",
"role_account": "yes",
"mx_accepts_mail": "yes",
"spamtrap": "no",
"mx_records": [
"in.mailsac.com",
"alt.mailsac.com"
],
"verification_mode": "quick",
"overall_score": null,
"safe_to_send": null,
"can_connect_smtp": null,
"inbox_full": null,
"catch_all": null,
"deliverable": null,
"disabled": null
},
{
"email": "xyz@centmil1.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"role_account": "no",
"mx_accepts_mail": "no",
"spamtrap": "no",
"mx_records": null,
"verification_mode": "quick",
"overall_score": null,
"safe_to_send": null,
"can_connect_smtp": null,
"inbox_full": null,
"catch_all": null,
"deliverable": null,
"disabled": null
},
{
"email": "user+to@domain1.com",
"status": "valid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"role_account": "no",
"mx_accepts_mail": "yes",
"spamtrap": "no",
"mx_records": [
"aspmx.l.google.com",
"alt1.aspmx.l.google.com",
"alt2.aspmx.l.google.com",
"aspmx2.googlemail.com",
"aspmx4.googlemail.com",
"aspmx3.googlemail.com",
"aspmx5.googlemail.com"
],
"verification_mode": "quick",
"overall_score": null,
"safe_to_send": null,
"can_connect_smtp": null,
"inbox_full": null,
"catch_all": null,
"deliverable": null,
"disabled": null
},
{
"email": "xyz@domain1.com",
"status": "valid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"role_account": "no",
"mx_accepts_mail": "yes",
"spamtrap": "no",
"mx_records": [
"aspmx.l.google.com",
"alt1.aspmx.l.google.com",
"alt2.aspmx.l.google.com",
"aspmx2.googlemail.com",
"aspmx4.googlemail.com",
"aspmx3.googlemail.com",
"aspmx5.googlemail.com"
],
"verification_mode": "quick",
"overall_score": null,
"safe_to_send": null,
"can_connect_smtp": null,
"inbox_full": null,
"catch_all": null,
"deliverable": null,
"disabled": null
},
{
"email": "abc@domain1.com",
"status": "valid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"role_account": "yes",
"mx_accepts_mail": "yes",
"spamtrap": "no",
"mx_records": [
"aspmx.l.google.com",
"alt1.aspmx.l.google.com",
"alt2.aspmx.l.google.com",
"aspmx2.googlemail.com",
"aspmx4.googlemail.com",
"aspmx3.googlemail.com",
"aspmx5.googlemail.com"
],
"verification_mode": "quick",
"overall_score": null,
"safe_to_send": null,
"can_connect_smtp": null,
"inbox_full": null,
"catch_all": null,
"deliverable": null,
"disabled": null
},
{
"email": "123@domain1.com",
"status": "valid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"role_account": "yes",
"mx_accepts_mail": "yes",
"spamtrap": "no",
"mx_records": [
"aspmx.l.google.com",
"alt1.aspmx.l.google.com",
"alt2.aspmx.l.google.com",
"aspmx2.googlemail.com",
"aspmx4.googlemail.com",
"aspmx3.googlemail.com",
"aspmx5.googlemail.com"
],
"verification_mode": "quick",
"overall_score": null,
"safe_to_send": null,
"can_connect_smtp": null,
"inbox_full": null,
"catch_all": null,
"deliverable": null,
"disabled": null
},
{
"email": "pop@domain1.com",
"status": "valid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"role_account": "no",
"mx_accepts_mail": "yes",
"spamtrap": "no",
"mx_records": [
"aspmx.l.google.com",
"alt1.aspmx.l.google.com",
"alt2.aspmx.l.google.com",
"aspmx2.googlemail.com",
"aspmx4.googlemail.com",
"aspmx3.googlemail.com",
"aspmx5.googlemail.com"
],
"verification_mode": "quick",
"overall_score": null,
"safe_to_send": null,
"can_connect_smtp": null,
"inbox_full": null,
"catch_all": null,
"deliverable": null,
"disabled": null
},
{
"email": "pip@domain1.com",
"status": "valid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"role_account": "no",
"mx_accepts_mail": "yes",
"spamtrap": "no",
"mx_records": [
"aspmx.l.google.com",
"alt1.aspmx.l.google.com",
"alt2.aspmx.l.google.com",
"aspmx2.googlemail.com",
"aspmx4.googlemail.com",
"aspmx3.googlemail.com",
"aspmx5.googlemail.com"
],
"verification_mode": "quick",
"overall_score": null,
"safe_to_send": null,
"can_connect_smtp": null,
"inbox_full": null,
"catch_all": null,
"deliverable": null,
"disabled": null
},
{
"email": "user@tempr.email",
"status": "disposable",
"status_code": null,
"free_email": "yes",
"disposable_email": "yes",
"role_account": "yes",
"mx_accepts_mail": "yes",
"spamtrap": "no",
"mx_records": [
"mx.discard.email"
],
"verification_mode": "quick",
"overall_score": null,
"safe_to_send": null,
"can_connect_smtp": null,
"inbox_full": null,
"catch_all": null,
"deliverable": null,
"disabled": null
},
{
"email": "info@domain2.com",
"status": "valid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"role_account": "yes",
"mx_accepts_mail": "yes",
"spamtrap": "no",
"mx_records": [
"aspmx.l.google.com",
"alt2.aspmx.l.google.com",
"alt1.aspmx.l.google.com",
"aspmx2.googlemail.com",
"aspmx5.googlemail.com",
"aspmx3.googlemail.com",
"aspmx4.googlemail.com"
],
"verification_mode": "quick",
"overall_score": null,
"safe_to_send": null,
"can_connect_smtp": null,
"inbox_full": null,
"catch_all": null,
"deliverable": null,
"disabled": null
},
{
"email": "user@gmail.com",
"status": "valid",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"role_account": "no",
"mx_accepts_mail": "yes",
"spamtrap": "no",
"mx_records": [
"gmail-smtp-in.l.google.com",
"alt1.gmail-smtp-in.l.google.com",
"alt2.gmail-smtp-in.l.google.com",
"alt3.gmail-smtp-in.l.google.com",
"alt4.gmail-smtp-in.l.google.com"
],
"verification_mode": "quick",
"overall_score": null,
"safe_to_send": null,
"can_connect_smtp": null,
"inbox_full": null,
"catch_all": null,
"deliverable": null,
"disabled": null
},
{
"email": "op999@gmail.com",
"status": "valid",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"role_account": "no",
"mx_accepts_mail": "yes",
"spamtrap": "no",
"mx_records": [
"gmail-smtp-in.l.google.com",
"alt1.gmail-smtp-in.l.google.com",
"alt2.gmail-smtp-in.l.google.com",
"alt3.gmail-smtp-in.l.google.com",
"alt4.gmail-smtp-in.l.google.com"
],
"verification_mode": "quick",
"overall_score": null,
"safe_to_send": null,
"can_connect_smtp": null,
"inbox_full": null,
"catch_all": null,
"deliverable": null,
"disabled": null
},
{
"email": "user@yahoo.com",
"status": "valid",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"role_account": "no",
"mx_accepts_mail": "yes",
"spamtrap": "no",
"mx_records": [
"mta7.am0.yahoodns.net",
"mta5.am0.yahoodns.net",
"mta6.am0.yahoodns.net"
],
"verification_mode": "quick",
"overall_score": null,
"safe_to_send": null,
"can_connect_smtp": null,
"inbox_full": null,
"catch_all": null,
"deliverable": null,
"disabled": null
},
{
"email": "user1@outlook.com",
"status": "valid",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"role_account": "no",
"mx_accepts_mail": "yes",
"spamtrap": "no",
"mx_records": [
"outlook-com.olc.protection.outlook.com"
],
"verification_mode": "quick",
"overall_score": null,
"safe_to_send": null,
"can_connect_smtp": null,
"inbox_full": null,
"catch_all": null,
"deliverable": null,
"disabled": null
},
{
"email": "user2@hotmail.com",
"status": "valid",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"role_account": "no",
"mx_accepts_mail": "yes",
"spamtrap": "no",
"mx_records": [
"hotmail-com.olc.protection.outlook.com"
],
"verification_mode": "quick",
"overall_score": null,
"safe_to_send": null,
"can_connect_smtp": null,
"inbox_full": null,
"catch_all": null,
"deliverable": null,
"disabled": null
}
]
real 0m2.176s
user 0m2.350s
sys 0m0.050s
Add Bouncify API support
Bouncify API enabled run -api bouncify -apikey_bf $bfkey -tm all with specified email address -e hnyfmw@canadlan-drugs.com. The status, free_email_api, disposable_email_api, role_api, and spamtrap_api JSON field are from API and free_email and disposable_email JSON fields are from local script database checks.
time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api bouncify -apikey_bf $bfkey
[
{
"email": "hnyfmw@canadlan-drugs.com",
"status": "undeliverable",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no",
"disposable_email_api": "no",
"role_api": "no",
"spamtrap_api": "no"
}
]
real 0m7.900s
user 0m0.357s
sys 0m0.030s
For email per verification API check for list of emails in emaillist.txt via -l emaillist.txt. The status, free_email_api, disposable_email_api, role_api, and spamtrap_api JSON field are from API and free_email and disposable_email JSON fields are from local script database checks.
Seems to be the slowest API processing time email verification providers tested to date and had a API issues. The diagnostic log shows that Bouncify API marked incorrectly that the user@yahoo.com email address as an accept-all email address and validation for user2@hotmail.com email address timed out. Their API docs at https://bouncify.readme.io/reference/single-validation-api, suggest a 120 concurrent request API limit and that Apart from undeliverable, for the results deliverable, accept-all and unknown do not reject the email address and proceed with your work flow. Both accept-all and unknown emails could not be validated, so they may be valid email address.
2024-05-12 12:44:44,519 - ERROR - Unexpected API response for user2@hotmail.com: {'result': 'Validation timedout', 'success': False}
time python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api bouncify -apikey_bf $bfkey
[
{
"email": "user@mailsac.com",
"status": "undeliverable",
"status_code": null,
"free_email": "yes",
"disposable_email": "yes",
"free_email_api": "yes",
"disposable_email_api": "yes",
"role_api": "yes",
"spamtrap_api": "no"
},
{
"email": "xyz@centmil1.com",
"status": "undeliverable",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no",
"disposable_email_api": "no",
"role_api": "no",
"spamtrap_api": "no"
},
{
"email": "user+to@domain1.com",
"status": "deliverable",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no",
"disposable_email_api": "no",
"role_api": "no",
"spamtrap_api": "no"
},
{
"email": "xyz@domain1.com",
"status": "undeliverable",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no",
"disposable_email_api": "no",
"role_api": "no",
"spamtrap_api": "no"
},
{
"email": "abc@domain1.com",
"status": "undeliverable",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no",
"disposable_email_api": "no",
"role_api": "no",
"spamtrap_api": "no"
},
{
"email": "123@domain1.com",
"status": "undeliverable",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no",
"disposable_email_api": "no",
"role_api": "no",
"spamtrap_api": "no"
},
{
"email": "pop@domain1.com",
"status": "undeliverable",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no",
"disposable_email_api": "no",
"role_api": "no",
"spamtrap_api": "no"
},
{
"email": "pip@domain1.com",
"status": "undeliverable",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no",
"disposable_email_api": "no",
"role_api": "no",
"spamtrap_api": "no"
},
{
"email": "user@tempr.email",
"status": "undeliverable",
"status_code": null,
"free_email": "no",
"disposable_email": "yes",
"free_email_api": "no",
"disposable_email_api": "yes",
"role_api": "yes",
"spamtrap_api": "no"
},
{
"email": "info@domain2.com",
"status": "deliverable",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no",
"disposable_email_api": "no",
"role_api": "yes",
"spamtrap_api": "no"
},
{
"email": "user@gmail.com",
"status": "deliverable",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": "yes",
"disposable_email_api": "no",
"role_api": "no",
"spamtrap_api": "no"
},
{
"email": "op999@gmail.com",
"status": "undeliverable",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": "yes",
"disposable_email_api": "no",
"role_api": "no",
"spamtrap_api": "no"
},
{
"email": "user@yahoo.com",
"status": "accept-all",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": "yes",
"disposable_email_api": "no",
"role_api": "no",
"spamtrap_api": "no"
},
{
"email": "user1@outlook.com",
"status": "deliverable",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": "yes",
"disposable_email_api": "no",
"role_api": "no",
"spamtrap_api": "no"
},
{
"email": "user2@hotmail.com",
"status": "api_error",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": "no",
"disposable_email_api": "no",
"role_api": "no",
"spamtrap_api": "no"
}
]
real 3m4.412s
user 0m2.366s
sys 0m0.049s
Re-trying the Hotmail user2@hotmail.com re-tried individually worked without timeouts
time python validate_emails.py -f user@domain1.com -e user2@hotmail.com -tm all -api bouncify -apikey_bf $bfkey
[
{
"email": "user2@hotmail.com",
"status": "deliverable",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": "yes",
"disposable_email_api": "no",
"role_api": "no",
"spamtrap_api": "no"
}
]
real 0m3.516s
user 0m0.362s
sys 0m0.025s
Add Bounceless API support
Bounceless API enabled run -api bounceless -apikey_bl $blkey -tm all with specified email address -e hnyfmw@canadlan-drugs.com. The status, reason, free_email_api, disposable_email_api, role_api and accept_all JSON fields are from API and free_email and disposable_email JSON fields are from local script database checks.
This returned a correct status result of no_mx_record as expected, but the 15 email address sample test further below was highly inaccurate for known valid email addresses as you can see.
time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api bounceless -apikey_bl $blkey
[
{
"email": "hnyfmw@canadlan-drugs.com",
"status": "no_mx_record",
"reason": "no_mx_record",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no",
"disposable_email_api": "no",
"role_api": "no",
"accept_all": "no"
}
]
real 0m2.582s
user 0m0.395s
sys 0m0.022s
For email per verification API check for list of emails in emaillist.txt via -l emaillist.txt. The status, reason, free_email_api, disposable_email_api, role_api and accept_all JSON fields are from API and free_email and disposable_email JSON fields are from local script database checks.
Unfortunately, this has to be the worse email verification result I have received for my sample 15 email addresses compared to all other commercial email verification providers. All the known valid emails are marked as unknown - not 1 valid email address below was marked correctly as valid! I double checked on their web dashboard inputting single known valid email addresses and they return the same incorrect status as below API results gave.
time python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api bounceless -apikey_bl $blkey
[
{
"email": "user@mailsac.com",
"status": "unknown",
"reason": "unknown",
"status_code": null,
"free_email": "yes",
"disposable_email": "yes",
"free_email_api": "yes",
"disposable_email_api": "no",
"role_api": "yes",
"accept_all": "no"
},
{
"email": "xyz@centmil1.com",
"status": "no_mx_record",
"reason": "no_mx_record",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no",
"disposable_email_api": "no",
"role_api": "no",
"accept_all": "no"
},
{
"email": "user+to@domain1.com",
"status": "Invalid Syntax",
"reason": "Syntax Error",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": "yes",
"disposable_email_api": "no",
"role_api": "yes",
"accept_all": "no"
},
{
"email": "xyz@domain1.com",
"status": "unknown",
"reason": "unknown",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": "yes",
"disposable_email_api": "no",
"role_api": "yes",
"accept_all": "no"
},
{
"email": "abc@domain1.com",
"status": "unknown",
"reason": "unknown",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": "yes",
"disposable_email_api": "no",
"role_api": "yes",
"accept_all": "no"
},
{
"email": "123@domain1.com",
"status": "unknown",
"reason": "unknown",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": "yes",
"disposable_email_api": "no",
"role_api": "yes",
"accept_all": "no"
},
{
"email": "pop@domain1.com",
"status": "unknown",
"reason": "unknown",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": "yes",
"disposable_email_api": "no",
"role_api": "yes",
"accept_all": "no"
},
{
"email": "pip@domain1.com",
"status": "unknown",
"reason": "unknown",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": "yes",
"disposable_email_api": "no",
"role_api": "yes",
"accept_all": "no"
},
{
"email": "user@tempr.email",
"status": "invalid",
"reason": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "yes",
"free_email_api": "no",
"disposable_email_api": "yes",
"role_api": "no",
"accept_all": "no"
},
{
"email": "info@domain2.com",
"status": "unknown",
"reason": "unknown",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": "yes",
"disposable_email_api": "no",
"role_api": "yes",
"accept_all": "no"
},
{
"email": "user@gmail.com",
"status": "unknown",
"reason": "unknown",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": "yes",
"disposable_email_api": "no",
"role_api": "yes",
"accept_all": "no"
},
{
"email": "op999@gmail.com",
"status": "unknown",
"reason": "unknown",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": "yes",
"disposable_email_api": "no",
"role_api": "yes",
"accept_all": "no"
},
{
"email": "user@yahoo.com",
"status": "unknown",
"reason": "unknown",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": "yes",
"disposable_email_api": "no",
"role_api": "yes",
"accept_all": "no"
},
{
"email": "user1@outlook.com",
"status": "unknown",
"reason": "unknown",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": "yes",
"disposable_email_api": "no",
"role_api": "yes",
"accept_all": "no"
},
{
"email": "user2@hotmail.com",
"status": "unknown",
"reason": "unknown",
"status_code": null,
"free_email": "yes",
"disposable_email": "no",
"free_email_api": "yes",
"disposable_email_api": "no",
"role_api": "yes",
"accept_all": "no"
}
]
real 0m22.085s
user 0m2.354s
sys 0m0.061s
To confirm and verify, I tested Bounceless's API directly and same result for known valid email address user@gmail.com which returns a result of unknown! Also API response time was very slow for single email verification result at 15.825s and for above 15 email address samples was 22.085s.
time curl -s "https://apps.bounceless.io/api/singlemaildetails?secret=$blkey&email=user@gmail.com" | jq -r
{
"success": true,
"accept_all": false,
"result": "unknown",
"reason": "unknown",
"role": true,
"free": true,
"disposable": false,
"user": "",
"domain": "",
"email": "user@gmail.com",
"did_you_mean": null,
"message": ""
}
real 0m15.825s
user 0m0.028s
sys 0m0.004s
After 1/2 day, I tried retesting Bounceless API against known valid Gmail address, and it seems it fluctuates between a result status of unknown and valid between runs. Maybe it's due to some security mechanisms on Gmail's server end but other commercial provider's APIs have always returned correctly for this known valid Gmail address. Note though the slower API result times >12-15 seconds remain.
time curl -s "https://apps.bounceless.io/api/singlemaildetails?secret=$blkey&email=user@gmail.com" | jq -r
{
"success": true,
"accept_all": false,
"result": "valid",
"reason": "valid",
"role": false,
"free": true,
"disposable": false,
"user": "user",
"domain": "gmail.com",
"email": "user@gmail.com",
"did_you_mean": null,
"message": ""
}
real 0m12.500s
user 0m0.029s
sys 0m0.004s
Added support for -apimerge argument which allows you to merge Merging EmailListVerify + MillionVerifier API results together for more accurate email verification results.
The table below shows how long it took to execute and process the verification checks using validate_emails.py and merged APIs. Looks like subsequent runs were faster due to probably primed caches at respective providers' backends.
| API Merge Command | Processing Time |
|---|---|
| Per Email Verification | 15.946 seconds |
| Bulk API File Upload | 47.536 seconds |
| Per Email Verification with Xenforo | 10.666 seconds |
| Bulk API File Upload with Xenforo | 41.260 seconds |
Merging EmailListVerify + MillionVerifier API results for both into one JSON result output for per email verification checks
time python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey -api millionverifier -apikey_mv $mvkey -apimerge
[
{
"email": "user@mailsac.com",
"elv_status": "disposable",
"elv_status_code": null,
"elv_free_email": "yes",
"elv_disposable_email": "yes",
"mv_status": "disposable",
"mv_status_code": null,
"mv_free_email": "yes",
"mv_disposable_email": "yes",
"mv_free_email_api": false,
"mv_role_api": true
},
{
"email": "xyz@centmil1.com",
"elv_status": "invalid",
"elv_status_code": null,
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "invalid",
"mv_status_code": null,
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": false,
"mv_role_api": false
},
{
"email": "user+to@domain1.com",
"elv_status": "ok",
"elv_status_code": null,
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "ok",
"mv_status_code": null,
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": false,
"mv_role_api": false
},
{
"email": "user@tempr.email",
"elv_status": "disposable",
"elv_status_code": null,
"elv_free_email": "no",
"elv_disposable_email": "yes",
"mv_status": "disposable",
"mv_status_code": null,
"mv_free_email": "no",
"mv_disposable_email": "yes",
"mv_free_email_api": false,
"mv_role_api": true
},
{
"email": "info@domain2.com",
"elv_status": "ok",
"elv_status_code": null,
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "ok",
"mv_status_code": null,
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": false,
"mv_role_api": true
},
{
"email": "xyz@domain1.com",
"elv_status": "invalid",
"elv_status_code": null,
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "invalid",
"mv_status_code": null,
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": false,
"mv_role_api": false
},
{
"email": "abc@domain1.com",
"elv_status": "invalid",
"elv_status_code": null,
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "invalid",
"mv_status_code": null,
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": false,
"mv_role_api": true
},
{
"email": "123@domain1.com",
"elv_status": "invalid",
"elv_status_code": null,
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "invalid",
"mv_status_code": null,
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": false,
"mv_role_api": false
},
{
"email": "pop@domain1.com",
"elv_status": "invalid",
"elv_status_code": null,
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "invalid",
"mv_status_code": null,
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": false,
"mv_role_api": false
},
{
"email": "pip@domain1.com",
"elv_status": "invalid",
"elv_status_code": null,
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "invalid",
"mv_status_code": null,
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": false,
"mv_role_api": false
},
{
"email": "user@gmail.com",
"elv_status": "ok",
"elv_status_code": null,
"elv_free_email": "yes",
"elv_disposable_email": "no",
"mv_status": "ok",
"mv_status_code": null,
"mv_free_email": "yes",
"mv_disposable_email": "no",
"mv_free_email_api": true,
"mv_role_api": false
},
{
"email": "op999@gmail.com",
"elv_status": "invalid",
"elv_status_code": null,
"elv_free_email": "yes",
"elv_disposable_email": "no",
"mv_status": "invalid",
"mv_status_code": null,
"mv_free_email": "yes",
"mv_disposable_email": "no",
"mv_free_email_api": true,
"mv_role_api": false
},
{
"email": "user@yahoo.com",
"elv_status": "ok",
"elv_status_code": null,
"elv_free_email": "yes",
"elv_disposable_email": "no",
"mv_status": "ok",
"mv_status_code": null,
"mv_free_email": "yes",
"mv_disposable_email": "no",
"mv_free_email_api": true,
"mv_role_api": false
},
{
"email": "user1@outlook.com",
"elv_status": "ok",
"elv_status_code": null,
"elv_free_email": "yes",
"elv_disposable_email": "no",
"mv_status": "ok",
"mv_status_code": null,
"mv_free_email": "yes",
"mv_disposable_email": "no",
"mv_free_email_api": true,
"mv_role_api": false
},
{
"email": "user2@hotmail.com",
"elv_status": "ok",
"elv_status_code": null,
"elv_free_email": "yes",
"elv_disposable_email": "no",
"mv_status": "ok",
"mv_status_code": null,
"mv_free_email": "yes",
"mv_disposable_email": "no",
"mv_free_email_api": true,
"mv_role_api": false
}
]
real 0m15.946s
user 0m1.017s
sys 0m0.037s
Merging EmailListVerify + MillionVerifier API results for both into one JSON result output for bulk API file upload checks -apibulk
time python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey -apibulk emaillistverify -api millionverifier -apikey_mv $mvkey -apibulk millionverifier -apimerge
[
{
"email": "user@mailsac.com",
"elv_status": "disposable",
"elv_status_code": "",
"elv_free_email": "yes",
"elv_disposable_email": "yes",
"mv_status": "disposable",
"mv_free_email": "yes",
"mv_disposable_email": "yes",
"mv_free_email_api": "no",
"mv_role_api": "yes"
},
{
"email": "xyz@centmil1.com",
"elv_status": "dead_server",
"elv_status_code": "",
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "invalid",
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": "no",
"mv_role_api": "no"
},
{
"email": "user+to@domain1.com",
"elv_status": "valid",
"elv_status_code": "",
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "ok",
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": "no",
"mv_role_api": "no"
},
{
"email": "user@tempr.email",
"elv_status": "disposable",
"elv_status_code": "",
"elv_free_email": "no",
"elv_disposable_email": "yes",
"mv_status": "disposable",
"mv_free_email": "no",
"mv_disposable_email": "yes",
"mv_free_email_api": "no",
"mv_role_api": "yes"
},
{
"email": "info@domain2.com",
"elv_status": "valid",
"elv_status_code": "",
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "ok",
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": "no",
"mv_role_api": "yes"
},
{
"email": "xyz@domain1.com",
"elv_status": "email_disabled",
"elv_status_code": "",
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "invalid",
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": "no",
"mv_role_api": "no"
},
{
"email": "abc@domain1.com",
"elv_status": "email_disabled",
"elv_status_code": "",
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "invalid",
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": "no",
"mv_role_api": "yes"
},
{
"email": "123@domain1.com",
"elv_status": "email_disabled",
"elv_status_code": "",
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "invalid",
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": "no",
"mv_role_api": "no"
},
{
"email": "pop@domain1.com",
"elv_status": "email_disabled",
"elv_status_code": "",
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "invalid",
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": "no",
"mv_role_api": "no"
},
{
"email": "pip@domain1.com",
"elv_status": "email_disabled",
"elv_status_code": "",
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "invalid",
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": "no",
"mv_role_api": "no"
},
{
"email": "user@gmail.com",
"elv_status": "valid",
"elv_status_code": "",
"elv_free_email": "yes",
"elv_disposable_email": "no",
"mv_status": "ok",
"mv_free_email": "yes",
"mv_disposable_email": "no",
"mv_free_email_api": "yes",
"mv_role_api": "no"
},
{
"email": "op999@gmail.com",
"elv_status": "email_disabled",
"elv_status_code": "",
"elv_free_email": "yes",
"elv_disposable_email": "no",
"mv_status": "invalid",
"mv_free_email": "yes",
"mv_disposable_email": "no",
"mv_free_email_api": "yes",
"mv_role_api": "no"
},
{
"email": "user@yahoo.com",
"elv_status": "valid",
"elv_status_code": "",
"elv_free_email": "yes",
"elv_disposable_email": "no",
"mv_status": "unknown",
"mv_free_email": "yes",
"mv_disposable_email": "no",
"mv_free_email_api": "yes",
"mv_role_api": "no"
},
{
"email": "user1@outlook.com",
"elv_status": "valid",
"elv_status_code": "",
"elv_free_email": "yes",
"elv_disposable_email": "no",
"mv_status": "ok",
"mv_free_email": "yes",
"mv_disposable_email": "no",
"mv_free_email_api": "yes",
"mv_role_api": "no"
},
{
"email": "user2@hotmail.com",
"elv_status": "valid",
"elv_status_code": "",
"elv_free_email": "yes",
"elv_disposable_email": "no",
"mv_status": "ok",
"mv_free_email": "yes",
"mv_disposable_email": "no",
"mv_free_email_api": "yes",
"mv_role_api": "no"
}
]
real 0m47.536s
user 0m0.612s
sys 0m0.021s
Merging EmailListVerify + MillionVerifier API results for both into one JSON result output for per email verification checks + Xenforo flags
time python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey -api millionverifier -apikey_mv $mvkey -apimerge -xf -xfdb xenforo -xfprefix xf_
[
{
"email": "user@mailsac.com",
"elv_status": "disposable",
"elv_status_code": null,
"elv_free_email": "yes",
"elv_disposable_email": "yes",
"mv_status": "disposable",
"mv_status_code": null,
"mv_free_email": "yes",
"mv_disposable_email": "yes",
"mv_free_email_api": false,
"mv_role_api": true,
"elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';\" xenforo",
"elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';",
"elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'user@mailsac.com'\\G\" xenforo",
"mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';\" xenforo",
"mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';",
"mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'user@mailsac.com'\\G\" xenforo"
},
{
"email": "xyz@centmil1.com",
"elv_status": "invalid",
"elv_status_code": null,
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "invalid",
"mv_status_code": null,
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": false,
"mv_role_api": false,
"elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';\" xenforo",
"elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';",
"elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'xyz@centmil1.com'\\G\" xenforo",
"mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';\" xenforo",
"mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';",
"mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'xyz@centmil1.com'\\G\" xenforo"
},
{
"email": "user+to@domain1.com",
"elv_status": "ok",
"elv_status_code": null,
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "ok",
"mv_status_code": null,
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": false,
"mv_role_api": false
},
{
"email": "user@tempr.email",
"elv_status": "disposable",
"elv_status_code": null,
"elv_free_email": "no",
"elv_disposable_email": "yes",
"mv_status": "disposable",
"mv_status_code": null,
"mv_free_email": "no",
"mv_disposable_email": "yes",
"mv_free_email_api": false,
"mv_role_api": true,
"elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';\" xenforo",
"elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';",
"elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'user@tempr.email'\\G\" xenforo",
"mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';\" xenforo",
"mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';",
"mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'user@tempr.email'\\G\" xenforo"
},
{
"email": "info@domain2.com",
"elv_status": "ok",
"elv_status_code": null,
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "ok",
"mv_status_code": null,
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": false,
"mv_role_api": true
},
{
"email": "xyz@domain1.com",
"elv_status": "invalid",
"elv_status_code": null,
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "invalid",
"mv_status_code": null,
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": false,
"mv_role_api": false,
"elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';\" xenforo",
"elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';",
"elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'xyz@domain1.com'\\G\" xenforo",
"mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';\" xenforo",
"mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';",
"mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'xyz@domain1.com'\\G\" xenforo"
},
{
"email": "abc@domain1.com",
"elv_status": "invalid",
"elv_status_code": null,
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "invalid",
"mv_status_code": null,
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": false,
"mv_role_api": true,
"elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';\" xenforo",
"elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';",
"elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'abc@domain1.com'\\G\" xenforo",
"mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';\" xenforo",
"mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';",
"mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'abc@domain1.com'\\G\" xenforo"
},
{
"email": "123@domain1.com",
"elv_status": "invalid",
"elv_status_code": null,
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "invalid",
"mv_status_code": null,
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": false,
"mv_role_api": false,
"elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';\" xenforo",
"elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';",
"elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '123@domain1.com'\\G\" xenforo",
"mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';\" xenforo",
"mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';",
"mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '123@domain1.com'\\G\" xenforo"
},
{
"email": "pop@domain1.com",
"elv_status": "invalid",
"elv_status_code": null,
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "invalid",
"mv_status_code": null,
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": false,
"mv_role_api": false,
"elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';\" xenforo",
"elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';",
"elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'pop@domain1.com'\\G\" xenforo",
"mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';\" xenforo",
"mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';",
"mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'pop@domain1.com'\\G\" xenforo"
},
{
"email": "pip@domain1.com",
"elv_status": "invalid",
"elv_status_code": null,
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "invalid",
"mv_status_code": null,
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": false,
"mv_role_api": false,
"elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';\" xenforo",
"elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';",
"elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'pip@domain1.com'\\G\" xenforo",
"mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';\" xenforo",
"mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';",
"mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'pip@domain1.com'\\G\" xenforo"
},
{
"email": "user@gmail.com",
"elv_status": "ok",
"elv_status_code": null,
"elv_free_email": "yes",
"elv_disposable_email": "no",
"mv_status": "ok",
"mv_status_code": null,
"mv_free_email": "yes",
"mv_disposable_email": "no",
"mv_free_email_api": true,
"mv_role_api": false
},
{
"email": "op999@gmail.com",
"elv_status": "invalid",
"elv_status_code": null,
"elv_free_email": "yes",
"elv_disposable_email": "no",
"mv_status": "invalid",
"mv_status_code": null,
"mv_free_email": "yes",
"mv_disposable_email": "no",
"mv_free_email_api": true,
"mv_role_api": false,
"elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';\" xenforo",
"elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';",
"elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'op999@gmail.com'\\G\" xenforo",
"mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';\" xenforo",
"mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';",
"mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'op999@gmail.com'\\G\" xenforo"
},
{
"email": "user@yahoo.com",
"elv_status": "ok",
"elv_status_code": null,
"elv_free_email": "yes",
"elv_disposable_email": "no",
"mv_status": "ok",
"mv_status_code": null,
"mv_free_email": "yes",
"mv_disposable_email": "no",
"mv_free_email_api": true,
"mv_role_api": false
},
{
"email": "user1@outlook.com",
"elv_status": "ok",
"elv_status_code": null,
"elv_free_email": "yes",
"elv_disposable_email": "no",
"mv_status": "ok",
"mv_status_code": null,
"mv_free_email": "yes",
"mv_disposable_email": "no",
"mv_free_email_api": true,
"mv_role_api": false
},
{
"email": "user2@hotmail.com",
"elv_status": "ok",
"elv_status_code": null,
"elv_free_email": "yes",
"elv_disposable_email": "no",
"mv_status": "ok",
"mv_status_code": null,
"mv_free_email": "yes",
"mv_disposable_email": "no",
"mv_free_email_api": true,
"mv_role_api": false
}
]
real 0m10.666s
user 0m1.008s
sys 0m0.034s
Merging EmailListVerify + MillionVerifier API results for both into one JSON result output for bulk API file upload checks -apibulk + Xenforo flags
time python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey -apibulk emaillistverify -api millionverifier -apikey_mv $mvkey -apibulk millionverifier -apimerge -xf -xfdb xenforo -xfprefix xf_
[
{
"email": "user@mailsac.com",
"elv_status": "disposable",
"elv_status_code": "",
"elv_free_email": "yes",
"elv_disposable_email": "yes",
"mv_status": "disposable",
"mv_free_email": "yes",
"mv_disposable_email": "yes",
"mv_free_email_api": "no",
"mv_role_api": "yes",
"elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';\" xenforo",
"elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';",
"elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'user@mailsac.com'\\G\" xenforo",
"mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';\" xenforo",
"mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';",
"mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'user@mailsac.com'\\G\" xenforo"
},
{
"email": "xyz@centmil1.com",
"elv_status": "dead_server",
"elv_status_code": "",
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "invalid",
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": "no",
"mv_role_api": "no",
"elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';\" xenforo",
"elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';",
"elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'xyz@centmil1.com'\\G\" xenforo",
"mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';\" xenforo",
"mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';",
"mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'xyz@centmil1.com'\\G\" xenforo"
},
{
"email": "user+to@domain1.com",
"elv_status": "valid",
"elv_status_code": "",
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "ok",
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": "no",
"mv_role_api": "no"
},
{
"email": "user@tempr.email",
"elv_status": "disposable",
"elv_status_code": "",
"elv_free_email": "no",
"elv_disposable_email": "yes",
"mv_status": "disposable",
"mv_free_email": "no",
"mv_disposable_email": "yes",
"mv_free_email_api": "no",
"mv_role_api": "yes",
"elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';\" xenforo",
"elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';",
"elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'user@tempr.email'\\G\" xenforo",
"mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';\" xenforo",
"mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';",
"mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'user@tempr.email'\\G\" xenforo"
},
{
"email": "info@domain2.com",
"elv_status": "valid",
"elv_status_code": "",
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "ok",
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": "no",
"mv_role_api": "yes"
},
{
"email": "xyz@domain1.com",
"elv_status": "email_disabled",
"elv_status_code": "",
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "invalid",
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": "no",
"mv_role_api": "no",
"elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';\" xenforo",
"elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';",
"elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'xyz@domain1.com'\\G\" xenforo",
"mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';\" xenforo",
"mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';",
"mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'xyz@domain1.com'\\G\" xenforo"
},
{
"email": "abc@domain1.com",
"elv_status": "email_disabled",
"elv_status_code": "",
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "invalid",
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": "no",
"mv_role_api": "yes",
"elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';\" xenforo",
"elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';",
"elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'abc@domain1.com'\\G\" xenforo",
"mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';\" xenforo",
"mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';",
"mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'abc@domain1.com'\\G\" xenforo"
},
{
"email": "123@domain1.com",
"elv_status": "email_disabled",
"elv_status_code": "",
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "invalid",
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": "no",
"mv_role_api": "no",
"elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';\" xenforo",
"elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';",
"elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '123@domain1.com'\\G\" xenforo",
"mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';\" xenforo",
"mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';",
"mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '123@domain1.com'\\G\" xenforo"
},
{
"email": "pop@domain1.com",
"elv_status": "email_disabled",
"elv_status_code": "",
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "invalid",
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": "no",
"mv_role_api": "no",
"elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';\" xenforo",
"elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';",
"elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'pop@domain1.com'\\G\" xenforo",
"mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';\" xenforo",
"mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';",
"mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'pop@domain1.com'\\G\" xenforo"
},
{
"email": "pip@domain1.com",
"elv_status": "email_disabled",
"elv_status_code": "",
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "invalid",
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": "no",
"mv_role_api": "no",
"elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';\" xenforo",
"elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';",
"elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'pip@domain1.com'\\G\" xenforo",
"mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';\" xenforo",
"mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';",
"mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'pip@domain1.com'\\G\" xenforo"
},
{
"email": "user@gmail.com",
"elv_status": "valid",
"elv_status_code": "",
"elv_free_email": "yes",
"elv_disposable_email": "no",
"mv_status": "ok",
"mv_free_email": "yes",
"mv_disposable_email": "no",
"mv_free_email_api": "yes",
"mv_role_api": "no"
},
{
"email": "op999@gmail.com",
"elv_status": "email_disabled",
"elv_status_code": "",
"elv_free_email": "yes",
"elv_disposable_email": "no",
"mv_status": "invalid",
"mv_free_email": "yes",
"mv_disposable_email": "no",
"mv_free_email_api": "yes",
"mv_role_api": "no",
"elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';\" xenforo",
"elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';",
"elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'op999@gmail.com'\\G\" xenforo",
"mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';\" xenforo",
"mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';",
"mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'op999@gmail.com'\\G\" xenforo"
},
{
"email": "user@yahoo.com",
"elv_status": "valid",
"elv_status_code": "",
"elv_free_email": "yes",
"elv_disposable_email": "no",
"mv_status": "ok",
"mv_free_email": "yes",
"mv_disposable_email": "no",
"mv_free_email_api": "yes",
"mv_role_api": "no"
},
{
"email": "user1@outlook.com",
"elv_status": "valid",
"elv_status_code": "",
"elv_free_email": "yes",
"elv_disposable_email": "no",
"mv_status": "ok",
"mv_free_email": "yes",
"mv_disposable_email": "no",
"mv_free_email_api": "yes",
"mv_role_api": "no"
},
{
"email": "user2@hotmail.com",
"elv_status": "valid",
"elv_status_code": "",
"elv_free_email": "yes",
"elv_disposable_email": "no",
"mv_status": "ok",
"mv_free_email": "yes",
"mv_disposable_email": "no",
"mv_free_email_api": "yes",
"mv_role_api": "no"
}
]
real 0m41.260s
user 0m0.581s
sys 0m0.033s
For API merged results, if you ran the commands and piped them into a results.txt file, you can then query and filter them using jq tool for different combinations of elv_status and mv_status values as follows:
- Find good emails, filter good emails where
elv_statusis "valid" andmv_statusis "ok":
cat results.txt | jq '.[] | select(.elv_status == "valid" and .mv_status == "ok")'cat results.txt | jq '.[] | select(.elv_status == "valid" and .mv_status == "ok")'
{
"email": "user+to@domain1.com",
"elv_status": "valid",
"elv_status_code": "",
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "ok",
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": "no",
"mv_role_api": "no"
}
{
"email": "info@domain2.com",
"elv_status": "valid",
"elv_status_code": "",
"elv_free_email": "no",
"elv_disposable_email": "no",
"mv_status": "ok",
"mv_free_email": "no",
"mv_disposable_email": "no",
"mv_free_email_api": "no",
"mv_role_api": "yes"
}
{
"email": "user@gmail.com",
"elv_status": "valid",
"elv_status_code": "",
"elv_free_email": "yes",
"elv_disposable_email": "no",
"mv_status": "ok",
"mv_free_email": "yes",
"mv_disposable_email": "no",
"mv_free_email_api": "yes",
"mv_role_api": "no"
}
{
"email": "user1@outlook.com",
"elv_status": "valid",
"elv_status_code": "",
"elv_free_email": "yes",
"elv_disposable_email": "no",
"mv_status": "ok",
"mv_free_email": "yes",
"mv_disposable_email": "no",
"mv_free_email_api": "yes",
"mv_role_api": "no"
}
{
"email": "user2@hotmail.com",
"elv_status": "valid",
"elv_status_code": "",
"elv_free_email": "yes",
"elv_disposable_email": "no",
"mv_status": "ok",
"mv_free_email": "yes",
"mv_disposable_email": "no",
"mv_free_email_api": "yes",
"mv_role_api": "no"
}
- Find bad emails, filter emails where
elv_statusis "invalid" andmv_statusis "invalid":
cat results.txt | jq '.[] | select(.elv_status == "invalid" and .mv_status == "invalid")'- Filter emails where
elv_statusis "valid" butmv_statusis not "ok":
This filters for if you ran MillionVerifier bulk API and there is a bug in unknown status, you can use EmailListVerify API to double check it's status.
cat results.txt | jq '.[] | select(.elv_status == "valid" and .mv_status != "ok")'cat results.txt | jq '.[] | select(.elv_status == "valid" and .mv_status != "ok")'
{
"email": "user@yahoo.com",
"elv_status": "valid",
"elv_status_code": "",
"elv_free_email": "yes",
"elv_disposable_email": "no",
"mv_status": "unknown",
"mv_free_email": "yes",
"mv_disposable_email": "no",
"mv_free_email_api": "yes",
"mv_role_api": "no"
}
- Filter emails where
elv_statusis not "valid" butmv_statusis "ok":
This would be the reverse of previous check, to double check EmailListVerify's result against MillionVerifier
cat results.txt | jq '.[] | select(.elv_status != "valid" and .mv_status == "ok")'- Filter bad emails where
elv_statusis not "valid" andmv_statusis not "ok":
cat results.txt | jq '.[] | select(.elv_status != "valid" and .mv_status != "ok")'- Filter emails where
elv_statusis "disposable" andmv_statusis "disposable":
cat results.txt | jq '.[] | select(.elv_status == "disposable" and .mv_status == "disposable")'- Filter emails where
elv_statusis "unknown" andmv_statusis "unknown":
cat results.txt | jq '.[] | select(.elv_status == "unknown" and .mv_status == "unknown")'- Filter emails where either
elv_statusormv_statusis "invalid":
cat results.txt | jq '.[] | select(.elv_status == "invalid" or .mv_status == "invalid")'- Filter emails where either
elv_statusormv_statusis "disposable":
cat results.txt | jq '.[] | select(.elv_status == "disposable" or .mv_status == "disposable")'- Filter emails where either
elv_statusormv_statusis "unknown":
cat results.txt | jq '.[] | select(.elv_status == "unknown" or .mv_status == "unknown")'- Filter emails where
elv_statusis "valid" andmv_statusis "unknown":
This filters for if you ran MillionVerifier bulk API and there is a bug in unknown status, you can use EmailListVerify API to double check it's status.
cat results.txt | jq '.[] | select(.elv_status == "valid" and .mv_status == "unknown")'
cat results.txt | jq '.[] | select(.elv_status == "valid" and .mv_status == "unknown")'
{
"email": "user@yahoo.com",
"elv_status": "valid",
"elv_status_code": "",
"elv_free_email": "yes",
"elv_disposable_email": "no",
"mv_status": "unknown",
"mv_free_email": "yes",
"mv_disposable_email": "no",
"mv_free_email_api": "yes",
"mv_role_api": "no"
}
These jq queries cover various combinations of elv_status and mv_status values, allowing you to filter the results.txt file based on different criteria. You can adjust the specific status values in the queries according to your needs and the available status values in the results.txt file.
Remember to replace results.txt with the actual path to your file if it's located in a different directory.
validate_emails.py script's EmailListVerify, MillionVerifier and Zerobounce per email check API routines has been updated to support a custom Cloudflare HTTP forward proxy Worker cache configuration which can take the script's API request and forward it to EmailListVerify's API endpoint. The Cloudflare Worker script will then save the API result into Cloudflare KV storage on their edge servers and save with a date timestamp. This can potentially reduce your overall EmailListVerify per email verification costs if you need to run validate_emails.py a few times back to back bypassing having to need to call validate_emails.py API itself.
validate_emails.py script added -apicache, -apicachettl, -apicache-purge and -apicachecheck arguments:
-apicachethis sets the Cloudflare Worker'scacheKeyand allows extending caching to other API providers in future. For now supported value areemaillistverifyandzerobouncewhich will end up creating thecacheKeyin Workerconst cacheKey = ${apiCache}:${email};for lookups etc.-apicachechecktakescountorlistorpurgeoption to query the Cloudflare KV storage cache to count number of cached entries or list the entries themselves or purge Cloudflare CDN/KV stores in cache.-apicache-purgewill purge Cloudflare CDN/KV cache when-apicachecheckset topurgeoptions to query the-apicachettlthis sets the cache TTL duration in seconds for how long Cloudflare CDN/KV stores in cache. Default value is 300s or 5mins
One usage case for this would be if you verify a list of 1,000 email addresses and in a short amount of time (i.e. 24hrs) have an additional 500 email addresses added to the email list to total 1,500 emails. Then if you had originally verified the list with -apicache and -apicachettl 172800 parameters, and did a second verification run, the original 1,000 email addresses would of already been stored in Cloudflare CDN and/or Cloudflare Worker KV storage caching so would not result in an API request/costs. Leaving only the 500 new email addresses resulting in an API request/costs. However, you would get a full JSON formatted result output for all 1,500 email addresses - ready for further processing/manipulation etc. Of course, you can also just have 2 separate verification runs for 1,000 emails and then for 500 emails and have 2 separate JSON formatted result outputs to work with which you can combine etc.
Another usage case is in case of email duplication in your lists. If you have the email address referenced multiple times in an email list, then using -apicache and -apicachettl 172800 parameters like parameters for first verification run, would allow it process and detect duplicates on second run via the Cloudflare CDN / Worker KV cached return results rather than make needless duplicate API request calls which would cost money. A lot of email verification providers offer email list deduplication as a built in feature while others offer it for additional costs. But with Cloudflare CDN / Worker KV caching in place, you wouldn't need to worry about the email verification provider's support for email deduplication. Thus saving your money $$$$$!
Examples to illustrate how the Cloudflare HTTP forward proxy caching KV worker workers for testing email address hnyfmw5@canadlan-drugs.com
Via direct EmailListVerify API call returns email address status = unknown
curl -s "https://apps.emaillistverify.com/api/verifyEmail?secret=$elvkey&email=hnyfmw5@canadlan-drugs.com&timeout=15"
unknown
Uncached usual run via the script usual result response would be unknown
time python validate_emails.py -f user@domain1.com -e hnyfmw5@canadlan-drugs.com -tm all -api emaillistverify -apikey $elvkey
[
{
"email": "hnyfmw5@canadlan-drugs.com",
"status": "invalid",
"status_code": null,
"free_email": "unknown",
"disposable_email": "no"
}
]
real 0m2.600s
user 0m0.279s
sys 0m0.020s
Via Cloudflare HTTP forward proxy caching KV worker with -apicachettl 120 argument set returns email address status = unknown reducing time to return the result from 2.6s to 0.397s
time python validate_emails.py -f user@domain1.com -e hnyfmw5@canadlan-drugs.com -tm all -api emaillistverify -apikey $elvkey -apicache emaillistverify -apicachettl 120
[
{
"email": "hnyfmw5@canadlan-drugs.com",
"status": "invalid",
"status_code": null,
"free_email": "unknown",
"disposable_email": "no"
}
]
real 0m0.397s
user 0m0.294s
sys 0m0.025s
Log inspection
cat email_verification_log_2024-05-08_15-08-05.log | tail -3
2024-05-08 15:08:06,816 - INFO - Checking cache for email: hnyfmw5@canadlan-drugs.com
2024-05-08 15:08:07,047 - INFO - Cache check response status code: 200
2024-05-08 15:08:07,047 - INFO - Cache result: unknown
Testing Cloudflare HTTP forward proxy caching KV worker directly
curl -s "https://cfcachedomain.com/?email=hnyfmw5@canadlan-drugs.com&cachettl=120"
unknown
Cloudflare HTTP forward proxy caching KV worker console logged
[DEBUG] Incoming request: https://cfcachedomain.com/?email=hnyfmw5@canadlan-drugs.com&cachettl=120
[DEBUG] Email: hnyfmw5@canadlan-drugs.com
[DEBUG] Cache Key: emaillistverify:hnyfmw5@canadlan-drugs.com
[DEBUG] Cache TTL: 120
[DEBUG] Cache Check: null
[DEBUG] API URL: https://apps.emaillistverify.com/api/verifyEmail?secret=APIKEY&email=hnyfmw5@canadlan-drugs.com&timeout=15
[DEBUG] Response from Cloudflare CDN cache: Hit
[DEBUG] Skipping KV cache update as response is served from Cloudflare CDN cache
[DEBUG] Returning final response with headers: {"cache-control":"max-age=120","content-type":"text/plain"}
Check how many KV storage cached email result entries there are
curl -s "https://cfcachedomain.com/?apicachecheck=count" | jq -r
{
"count": 1
}
Query the actual KV storage cached email address entries including the cache age
curl -s "https://cfcachedomain.com/?apicachecheck=list" | jq -r
[
{
"email": "hnyfmw5@canadlan-drugs.com",
"result": "unknown",
"timestamp": 1715175271549,
"age": 16,
"ttl": 120
}
]
Query the KV storage cache entries count via -apicachecheck count
time python validate_emails.py -f user@domain1.com -e hnyfmw5@canadlan-drugs.com -tm all -api emaillistverify -apikey $elvkey -apicache emaillistverify -apicachettl 120 -apicachecheck count
API cache count: 1
Query the KV storage cache entries listings via -apicachecheck list
time python validate_emails.py -f user@domain1.com -e hnyfmw5@canadlan-drugs.com -tm all -api emaillistverify -apikey $elvkey -apicache emaillistverify -apicachettl 120 -apicachecheck list
API cache list:
{'email': 'hnyfmw5@canadlan-drugs.com', 'result': 'unknown', 'timestamp': 1715175271549, 'age': 16, 'ttl': 120}
Cloudflare KV storage entries
| Key | Value |
|---|---|
| emaillistverify:hnyfmw5@canadlan-drugs.com | {"result":"unknown","timestamp":1715175271549,"ttl":120} |
May 17, 2023 added MillionVerifier Cloudflare cache support.
For MillionVerifier per email check API -api millionverifier -apikey_mv $mvkey with Cloudflare Cache -apicache millionverifier -apicachettl 120. Added api_response_time and api_thread_number JSON fields which measure the response time from Cloudflare Worker KV cached storage/store or Cloudflare CDN cache.
Note: updated MillionVerifier API JSON response to also report API returned subresult value.
time python validate_emails.py -f user@domain1.com -e hnyfmw2@canadlan-drugs.com -tm all -api millionverifier -apikey_mv $mvkey -apicache millionverifier -apicachettl 120
[
{
"email": "hnyfmw2@canadlan-drugs.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"api_response_time": 0.0001,
"api_thread_number": "cached",
"free_email_api": "no",
"role_api": "no",
"subresult": "dns_error"
}
]
real 0m0.776s
user 0m0.271s
sys 0m0.021s
Compared with uncached regular API response where MillionVerifier's API api_response_time = 0.2962 seconds compared to Cloudflare cached api_response_time = 0.001 seconds. While validate_emails.py script time difference was 0.776s cached vs 1.631s uncached.
time python validate_emails.py -f user@domain1.com -e hnyfmw2@canadlan-drugs.com -tm all -api millionverifier -apikey_mv $mvkey
[
{
"email": "hnyfmw2@canadlan-drugs.com",
"status": "invalid",
"subresult": "dns_error",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": false,
"role_api": false,
"api_response_time": 0.2962,
"api_thread_number": "thread-pool-0_0"
}
]
real 0m1.631s
user 0m0.356s
sys 0m0.025s
For ZeroBounce per email check API -api zerobounce -apikey_zb $zbkey with Cloudflare Cache -apicache zerobounce -apicachettl 900
time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -api zerobounce -apikey_zb $zbkey -tm all -apicache zerobounce -apicachettl 900
[
{
"email": "hnyfmw@canadlan-drugs.com",
"status": "invalid",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"api_response_time": 0.0,
"api_thread_number": "cached"
}
]
real 0m0.784s
user 0m0.260s
sys 0m0.027s
Log inspection
cat logs/$(ls -Art logs | tail -3 | grep 'email_verification')
2024-05-17 00:19:14,801 - INFO - Making cache check request to: https://cfworkerdomain.com?email=hnyfmw%40canadlan-drugs.com&cachettl=900&apicache=zerobounce
2024-05-17 00:19:14,986 - INFO - Cache result: {'address': 'hnyfmw@canadlan-drugs.com', 'status': 'invalid', 'sub_status': 'no_dns_entries', 'free_email': False, 'did_you_mean': None, 'account': 'hnyfmw', 'domain': 'canadlan-drugs.com', 'domain_age_days': '2032', 'smtp_provider': '', 'mx_found': 'false', 'mx_record': '', 'firstname': None, 'lastname': None, 'gender': None, 'country': None, 'region': None, 'city': None, 'zipcode': None, 'processed_at': '2024-05-17 00:08:48.644'}
Compared to regular non-cached ZeroBounce API request with api_response_time = 0.159 seconds using api_thread_number thread pool = 0_0. While validate_emails.py script time difference was 0.784s cached vs 4.501s uncached.
time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api zerobounce -apikey_zb $zbkey
[
[
{
"email": "hnyfmw@canadlan-drugs.com",
"status": "invalid",
"sub_status": "no_dns_entries",
"status_code": null,
"free_email": "no",
"disposable_email": "no",
"free_email_api": "no",
"api_response_time": 0.158,
"api_thread_number": "thread-pool-0_0"
}
]
]
real 0m4.501s
user 0m0.353s
sys 0m0.027s
Add support to purge Cloudflare KV storage via -apicache-purge -apicachecheck purge when combined with -apicache emaillistverify
python validate_emails.py -f user@domain1.com -l emaillist.txt -apicache-purge -apicache emaillistverify -apicachecheck purge
Cache purged successfully
Run with -apicachecheck count to report the number of cached entries in Cloudflare KV storage after cache purge:
python validate_emails.py -f user@domain1.com -l emaillist.txt -apicache-purge -apicache emaillistverify -apicachecheck count
API cache count: {'bulk_count': 0, 'email_count': 0}
Add Cloudflare cache support to EmailListVerify's bulk file API routine via -apicache emaillistverify -apicachettl 120 and ran it 3 times - for unprimed cache and primed cached run for 2nd and 3rd runs to compare time to completion. Cloudflare HTTP forward proxy KV cache Worker reduced times from 40.771s to 2.078s.
| Run | Compeletion Time |
|---|---|
| 1st Bulk File API Run uncached | 40.771s |
| 2nd Bulk File API Run cached | 2.292s |
| 3rd Bulk File API Run cached | 2.078s |
Example 1st EmailListVerify bulk API unprimed Cloudflare Worker cache run timed:
time python validate_emails.py -f user@domain1.com -l emaillist.txt -api emaillistverify -apikey $elvkey -apibulk emaillistverify -apicache emaillistverify -apicachettl 120 -tm all
[
{
"email": "user@mailsac.com",
"status": "disposable",
"status_code": "",
"free_email": "yes",
"disposable_email": "yes"
},
{
"email": "xyz@centmil1.com",
"status": "dead_server",
"status_code": "",
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user+to@domain1.com",
"status": "valid",
"status_code": "",
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@tempr.email",
"status": "disposable",
"status_code": "",
"free_email": "no",
"disposable_email": "yes"
},
{
"email": "info@domain2.com",
"status": "valid",
"status_code": "",
"free_email": "no",
"disposable_email": "no"
},
{
"email": "xyz@domain1.com",
"status": "email_disabled",
"status_code": "",
"free_email": "no",
"disposable_email": "no"
},
{
"email": "abc@domain1.com",
"status": "email_disabled",
"status_code": "",
"free_email": "no",
"disposable_email": "no"
},
{
"email": "123@domain1.com",
"status": "email_disabled",
"status_code": "",
"free_email": "no",
"disposable_email": "no"
},
{
"email": "pop@domain1.com",
"status": "email_disabled",
"status_code": "",
"free_email": "no",
"disposable_email": "no"
},
{
"email": "pip@domain1.com",
"status": "email_disabled",
"status_code": "",
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@gmail.com",
"status": "valid",
"status_code": "",
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "op999@gmail.com",
"status": "email_disabled",
"status_code": "",
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user@yahoo.com",
"status": "valid",
"status_code": "",
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user1@outlook.com",
"status": "valid",
"status_code": "",
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user2@hotmail.com",
"status": "valid",
"status_code": "",
"free_email": "yes",
"disposable_email": "no"
}
]
real 0m40.771s
user 0m0.469s
sys 0m0.019s
Inspecting logs
cat $(ls -Art | tail -3 | grep 'email_verification')
2024-05-10 09:59:28,893 - INFO - File MIME type: text/plain
2024-05-10 09:59:29,050 - INFO - Request data: {'filename': 'emaillist_20240510095928.txt'}
2024-05-10 09:59:29,050 - INFO - File data: {'file_contents': ('emaillist_20240510095928.txt', <_io.BufferedReader name='emaillist.txt'>, 'text/plain')}
2024-05-10 09:59:30,258 - INFO - File uploaded successfully. File ID: 2408431
2024-05-10 09:59:30,538 - INFO - File processing in progress. Status: progress
2024-05-10 09:59:36,056 - INFO - File processing in progress. Status: progress
2024-05-10 09:59:41,604 - INFO - File processing in progress. Status: progress
2024-05-10 09:59:47,171 - INFO - File processing in progress. Status: progress
2024-05-10 09:59:52,687 - INFO - File processing in progress. Status: progress
2024-05-10 09:59:57,959 - INFO - File processing in progress. Status: progress
2024-05-10 10:00:03,519 - INFO - File processing in progress. Status: progress
2024-05-10 10:00:08,927 - INFO - File processing completed. Retrieving results from: https://files-elv.s3.eu-central-1.amazonaws.com/2024-05/5b1ab4d47750dd66625245e1a0645328f93e8abc_all.csv
2024-05-10 10:00:09,259 - INFO - Results file downloaded: emaillistverify_results_1715335169.csv
2024-05-10 10:00:09,456 - INFO - Bulk file results cached in Cloudflare
2024-05-10 10:00:09,456 - INFO - Results retrieved successfully. Total lines: 15
Example 2nd EmailListVerify bulk API primed Cloudflare Worker cache run timed:
time python validate_emails.py -f user@domain1.com -l emaillist.txt -api emaillistverify -apikey $elvkey -apibulk emaillistverify -apicache emaillistverify -apicachettl 120 -tm all
[
{
"email": "user@mailsac.com",
"status": "unknown",
"status_code": null,
"free_email": "yes",
"disposable_email": "yes"
},
{
"email": "xyz@centmil1.com",
"status": "unknown",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user+to@domain1.com",
"status": "invalid_syntax",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@tempr.email",
"status": "unknown",
"status_code": null,
"free_email": "no",
"disposable_email": "yes"
},
{
"email": "info@domain2.com",
"status": "ok",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "xyz@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "abc@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "123@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "pop@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "pip@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@gmail.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "op999@gmail.com",
"status": "email_disabled",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user@yahoo.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user1@outlook.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user2@hotmail.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
}
]
real 0m2.292s
user 0m0.533s
sys 0m0.022s
Log inspection shows bulk file API upload process was skipped as all email addresses in bulk file -l emaillist.txt passed on command line were found in Cloudflare cache.
cat $(ls -Art | tail -3 | grep 'email_verification')
2024-05-10 10:34:03,308 - INFO - File MIME type: text/plain
2024-05-10 10:34:05,392 - INFO - All email results found in cache. Skipping file upload.
Example 3rd EmailListVerify bulk API primed Cloudflare Worker cache run timed:
time python validate_emails.py -f user@domain1.com -l emaillist.txt -api emaillistverify -apikey $elvkey -apibulk emaillistverify -apicache emaillistverify -apicachettl 120 -tm all
[
{
"email": "user@mailsac.com",
"status": "unknown",
"status_code": null,
"free_email": "yes",
"disposable_email": "yes"
},
{
"email": "xyz@centmil1.com",
"status": "unknown",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user+to@domain1.com",
"status": "invalid_syntax",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@tempr.email",
"status": "unknown",
"status_code": null,
"free_email": "no",
"disposable_email": "yes"
},
{
"email": "info@domain2.com",
"status": "ok",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "xyz@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "abc@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "123@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "pop@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "pip@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@gmail.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "op999@gmail.com",
"status": "email_disabled",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user@yahoo.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user1@outlook.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user2@hotmail.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
}
]
real 0m2.078s
user 0m0.527s
sys 0m0.038s
Log inspection shows bulk file API upload process was skipped as all email addresses in bulk file -l emaillist.txt passed on command line were found in Cloudflare cache.
cat $(ls -Art | tail -3 | grep 'email_verification')
2024-05-10 10:34:10,862 - INFO - File MIME type: text/plain
2024-05-10 10:34:12,724 - INFO - All email results found in cache. Skipping file upload.
This table presents a side-by-side comparison of the time taken for regular and cached EmailListVerify API checks. Testing Cloudflare HTTP Forward Proxy Cache With KV Storage with EmailListVerify per email check API. Ran the same 15 emails emaillist.txt test and timed the 3 runs each.
First cached email verification checks are slower due to priming the cache overhead. While subseqent cached runs were much faster compared to uncached regular email verification checks.
| Run | Regular Time | Cached Time |
|---|---|---|
| 1st Run | 5.102s | 5.437s |
| 2nd Run | 3.146s | 1.029s |
| 3rd Run | 3.248s | 0.944s |
Regular uncached run 1
time python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey
[
{
"email": "user@mailsac.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "yes"
},
{
"email": "xyz@centmil1.com",
"status": "invalid",
"status_code": null,
"free_email": "unknown",
"disposable_email": "no"
},
{
"email": "user+to@domain1.com",
"status": "ok",
"status_code": 250,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "xyz@domain1.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "abc@domain1.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "123@domain1.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "pop@domain1.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "pip@domain1.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@tempr.email",
"status": "ok",
"status_code": 250,
"free_email": "no",
"disposable_email": "yes"
},
{
"email": "info@domain2.com",
"status": "ok",
"status_code": 250,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@gmail.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "op999@gmail.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user@yahoo.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user1@outlook.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user2@hotmail.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "no"
}
]
real 0m5.102s
user 0m0.299s
sys 0m0.026s
Regular uncached run 2
time python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey
[
{
"email": "user@mailsac.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "yes"
},
{
"email": "xyz@centmil1.com",
"status": "invalid",
"status_code": null,
"free_email": "unknown",
"disposable_email": "no"
},
{
"email": "user+to@domain1.com",
"status": "ok",
"status_code": 250,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "xyz@domain1.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "abc@domain1.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "123@domain1.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "pop@domain1.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "pip@domain1.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@tempr.email",
"status": "ok",
"status_code": 250,
"free_email": "no",
"disposable_email": "yes"
},
{
"email": "info@domain2.com",
"status": "ok",
"status_code": 250,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@gmail.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "op999@gmail.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user@yahoo.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user1@outlook.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user2@hotmail.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "no"
}
]
real 0m3.146s
user 0m0.303s
sys 0m0.022s
Regular uncached run 3
time python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey
[
{
"email": "user@mailsac.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "yes"
},
{
"email": "xyz@centmil1.com",
"status": "invalid",
"status_code": null,
"free_email": "unknown",
"disposable_email": "no"
},
{
"email": "user+to@domain1.com",
"status": "ok",
"status_code": 250,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "xyz@domain1.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "abc@domain1.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "123@domain1.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "pop@domain1.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "pip@domain1.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@tempr.email",
"status": "ok",
"status_code": 250,
"free_email": "no",
"disposable_email": "yes"
},
{
"email": "info@domain2.com",
"status": "ok",
"status_code": 250,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@gmail.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "op999@gmail.com",
"status": "unknown_email",
"status_code": 550,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user@yahoo.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user1@outlook.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user2@hotmail.com",
"status": "ok",
"status_code": 250,
"free_email": "yes",
"disposable_email": "no"
}
]
real 0m3.248s
user 0m0.296s
sys 0m0.030s
Cached run 1
time python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey -apicache emaillistverify -apicachettl 120
[
{
"email": "user@mailsac.com",
"status": "unknown",
"status_code": null,
"free_email": "yes",
"disposable_email": "yes"
},
{
"email": "xyz@centmil1.com",
"status": "unknown",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user+to@domain1.com",
"status": "invalid_syntax",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "xyz@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "abc@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "123@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "pop@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "pip@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@tempr.email",
"status": "unknown",
"status_code": null,
"free_email": "no",
"disposable_email": "yes"
},
{
"email": "info@domain2.com",
"status": "ok",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@gmail.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "op999@gmail.com",
"status": "email_disabled",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user@yahoo.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user1@outlook.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user2@hotmail.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
}
]
real 0m5.437s
user 0m2.339s
sys 0m0.044s
Cached run 2
time python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey -apicache emaillistverify -apicachettl 120
[
{
"email": "user@mailsac.com",
"status": "unknown",
"status_code": null,
"free_email": "yes",
"disposable_email": "yes"
},
{
"email": "xyz@centmil1.com",
"status": "unknown",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user+to@domain1.com",
"status": "invalid_syntax",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "xyz@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "abc@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "123@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "pop@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "pip@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@tempr.email",
"status": "unknown",
"status_code": null,
"free_email": "no",
"disposable_email": "yes"
},
{
"email": "info@domain2.com",
"status": "ok",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@gmail.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "op999@gmail.com",
"status": "email_disabled",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user@yahoo.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user1@outlook.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user2@hotmail.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
}
]
real 0m1.029s
user 0m2.373s
sys 0m0.043s
Cached run 3
time python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey -apicache emaillistverify -apicachettl 120
[
{
"email": "user@mailsac.com",
"status": "unknown",
"status_code": null,
"free_email": "yes",
"disposable_email": "yes"
},
{
"email": "xyz@centmil1.com",
"status": "unknown",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user+to@domain1.com",
"status": "invalid_syntax",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "xyz@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "abc@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "123@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "pop@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "pip@domain1.com",
"status": "email_disabled",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@tempr.email",
"status": "unknown",
"status_code": null,
"free_email": "no",
"disposable_email": "yes"
},
{
"email": "info@domain2.com",
"status": "ok",
"status_code": null,
"free_email": "no",
"disposable_email": "no"
},
{
"email": "user@gmail.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "op999@gmail.com",
"status": "email_disabled",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user@yahoo.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user1@outlook.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
},
{
"email": "user2@hotmail.com",
"status": "ok",
"status_code": null,
"free_email": "yes",
"disposable_email": "no"
}
]
real 0m0.944s
user 0m2.316s
sys 0m0.050s
Created a simplistic PHP wrapper script to call validate_emails.py from that can test multiple email verification API providers as well as local non-API tests for a single inputted email address. The PHP wrapper will also time how long it takes to return an email verification check's JSON response. This was tested on a PHP 8.3.6 based Centmin Mod LEMP stack server.
| Provider | Completion Time |
|---|---|
| Local (Non-API) | 0.516784s |
| EmailListVerify | 2.96s |
| MillionVerifier | 0.84s |
| CaptainVerify | 21.96s |
| Proofy.io | 31.77s (API error, ran out of credits) |
| MyEmailVerifier | 3.09s |
| Zerobounce | 0.68s |
| Reoon | 0.72s |
| Bouncify | 1.04s |
First one is local non-API test = 0.516784s
EmailListVerify = 2.96s
MillionVerifier = 0.84s
CaptainVerify = 21.96s
Proofy.io = 31.77s for api_error ran out of credits right now
MyEmailVerifier = 3.09s
Zerobounce = 0.68s
Reoon = 0.72s
Bouncify = 1.04s
Updated PHP wrapper script with single and multiple email support via validate_emails.py per email verification routines and added validate_emails.py supported Cloudflare Cache (enabled for EmailListVerify and Zerobounce) and also support for S3 storage to store email verification results to either Amazon AWS S3 or Cloudflare R2 object storage buckets.
Note: Timings reported include time for S3 storage - in this case saving to Cloudflare R2 bucket
Single email address EmailListVerify runs including a debug run
Multiple email addresses EmailListVerify runs including a debug run
