🔨 List all IP ranges from: Google (Cloud & GoogleBot), Bing (Bingbot), Amazon (AWS), Microsoft, Oracle (Cloud), GitHub, Facebook (Meta), OpenAI (GPTBot) and other with daily updates.

microsoft digitalocean facebook osint twitter bing azure oracle google-cloud bug-bounty pentesting cidr googlebot bugbounty amazon-aws bingbot network-security iplist ip-ranges cidr-ranges

• Updated Nov 12, 2026
• Shell

This project is a Python bot that automates the process of logging into Gmail, joining a Google Meet, recording the audio of the meeting, and then generating a summary, key points, action items, and sentiment analysis of the meeting.

google googlebot google-api meet audio-processing googlemeet meetbot googlemeetbot googlemeetingbot

• Updated Dec 8, 2025
• Python

Updated lists of IP addresses/whitelists of good bots and crawlers. Includes GoogleBot, BingBot, DuckDuckBot, etc.

bot crawler whitelist firewall googlebot ip-addresses

• Updated Nov 12, 2026

Simple robots.txt template. Keep unwanted robots out (disallow). White lists (allow) legitimate user-agents. Useful for all websites.

search-engine whitelist user-agent seo crawling twitterbot robots-txt googlebot crawlers web-crawling bingbot robots-exclusion-standard blocking-bots web-robots search-engine-optimization baiduspider

• Updated Feb 16, 2025

Crawl, match, parse IP or IP range, check if IP or range is in another range. Support IPv4, IPv6, IP Interval, Wildcard and CIDR. Check if IP is Cloudflare node IP, Google bot IP. 爬取，正则匹配，解析 IP 和 IP 范围，检测 IP 或范围是否在另一个范围中。支持 IPv4，IPv6，区间、通配符或 CIDR 表示的 IP 范围。检测 IP 是否是 Cloudflare 节点或 Google 漫游器 IP

ipv6 ipv4 cloudflare googlebot

• Updated Jun 13, 2026
• PHP

Collection of IP addresses used by legitimate crawlers and services: Googlebot, Bingbot, AhrefsBot, UptimeRobot, Pingdom, Cloudflare, Bunny CDN, Stripe, Shodan, FacebookBot, TelegramBot, and more.

bot security crawler whitelist bots firewall ip-address safety googlebot safe ipset whitelists ip-addresses goodbot whitelist-bot safe-bots goodbots

• Updated Nov 12, 2026
• JavaScript

google for discord, yo

google discord-api googlebot

• Updated Oct 24, 2017
• JavaScript

🤔 Is this Web request from a real search engine🕷 or from an impersonating agent 🕵️‍♀️?

ruby bot ruby-gem search-engine security protection fake googlebot impersonation detect-crawlers

• Updated Nov 7, 2026
• Ruby

Curated list of common web crawler and bot User-Agent strings used across the internet.

bot crawler list user-agent spider detect scraping googlebot ua agents

• Updated Oct 28, 2026
• JavaScript

Cloudflare Radar verified bots directory — 500+ crawlers and search-engine user agents as data.

user-agent bots directory radar dataset cloudflare googlebot crawlers verified bot-list

• Updated Nov 9, 2026
• JavaScript

Check-list para reunir as principais tags a serem adicionadas na criação de páginas HTML para que os motores de busca façam a indexação do site de forma orgânica.

html search-engine sitemap seo schema-org robots-txt opengraph-tags googlebot serp metatags html-semantics lighthouse

• Updated Sep 12, 2023

Scraping Amazon website using Proxies for extracting Mobile details

json crawler proxy scrapy pycharm googlebot pypiwin32 amazon-scraper user-agents

• Updated May 30, 2019
• Python

Continuously-updated public IP ranges for major cloud providers, SaaS services, and bots — one txt file per provider, refreshed every 4 hours via GitHub Actions. Drop-in for firewalls, allowlists, and geo blocks.

aws ipv6 firewall ipv4 iptables cloudflare cidr googlebot ipset bingbot network-security bot-detection ip-ranges allowlist gptbot

• Updated Nov 12, 2026
• Shell

Django middleware to allow googlebot to index logged-in accessible content.

python django googlebot

• Updated Jun 22, 2022
• Python

Bot Untuk Mencari Sesuatu Di Google Via Telegram. Maintaned by Rio

heroku bot telegram-bot googlebot

• Updated Oct 9, 2021
• JavaScript

Shell Script for Monitoring GoogleBot Crawls via Nginx log file and Sending notification to Telegram

shell bash nginx telegram telegram-api shell-script googlebot bash-script hacktoberfest hactoberfest2021

• Updated Oct 11, 2021
• Shell

Validate search engine user agents and IP addresses.

python search-engine crawler spider googlebot

• Updated Feb 3, 2022
• Python

KnownBots is a Go library for verifying search engine crawlers and identifying legitimate bots.

search-engine bots seo geo googlebot ratelimit

• Updated Mar 18, 2026
• Go

Turn raw server/CDN access logs into verified-crawler analytics: parse many log formats, verify Googlebot/Bingbot by IP (not user-agent), enrich with DuckDB, and analyze crawl budget, crawl waste, and crawl traps with SQL.

python log-analysis ci seo access-logs googlebot observability bingbot log-parsing server-logs technical-seo duckdb crawl-budget crawler-verification

• Updated Jun 23, 2026
• Python

A Bash script that fetches and parses JSON-based IP range data for trusted search engine bots (Googlebot, Bingbot, and others), ideal for use with ModSecurity and other web application firewalls and web servers.

bash nginx security apache waf json-parser googlebot modsecurity web-application-firewall bingbot ip-ranges

• Updated Jun 27, 2025
• Shell