Every day I write about #osint (Open Source Intelligence) tools and techniques. Also little bit about forensics and cybersecurity in general. Work in https://t.me/netlas
Wayback Machine Telegram Collection Search
- 597,269,554 Telegram (t me) pages
- ability to find deleted content
- ability to see all search results (not just a small portion, as in Google)
- advanced search filters
web.archive.org/collection-search/telegram/
#osint #socmint
OSINT Funnel Methodology by twitter.com/0SINTr
STAGE 1: Search Engines
STAGE 2: Specialized Tools
STAGE 3: Social Avenues
STAGE 4: Data Breaches
STAGE 5: Dark Web
Github repo with tips and tools for each stage:
https://github.com/0SINTr/ofm
#osint #socmint
If the name of a person (object, place) can't be found using usual search engines or semantic AI search tools, then try to ask real people if they've seen anything matching your description.
Subreddit for such questions (2,5M+ members):
https://www.reddit.com/r/tipofmytongue/
#reddit
Today is a hot day at BlueSky (500+ new followers in a few days🙀). There's a mass migration of users from X.
I added to Advanced search operators list (https://github.com/cipher387/Advanced-search-operators-list/) links to search tips for BlueSky and Mastodon (and they are really good).
#socmint
Video Text Search
A tool that allows to quickly and accurately find a frame in a video by text description.
For very long videos, authorize on HuggingFace and duplicate the space.
https://huggingface.co/spaces/Pixeltable/Text-image-similarity-search-on-video-frames-embedding-indexes
Creator twitter.com/pixeltablehq
INSTATRACKER
Tools to track Instagram account changes:
- followers
- following
- posts
- bio
https://github.com/ibnaleem
(⚠️Instagram can ban for such tools, don't use accounts valuable to you for authorization)
Tip by twitter.com/HolismVision
#osint #socmint
5 Ways to Find Deleted Files
Image Analysis -> Analyzing the Files -> Recovering the Files:
- Sleuth Kit
- Extundelete
- TestDisk
- Foremost
- Scalpel
https://infosecwriteups.com/5-ways-i-can-find-your-deleted-files-as-an-ethical-hacker-4bc6508392fa
Author twitter.com/zeuscybersec
#dfir
🇦🇱🇦🇱🇦🇱
Albania #OSINT tools
- business databases
- licences databases
- transaction of the treasury data (with persons/company names)
- public procurements
and more.
https://www.osce.org/files/f/documents/3/0/201276.pdf (page 43)
Extremely simple but important tip.
If you need to quickly extract the most important information from Twitter account's posts (and other social networks too), do a post search for the word “My”.
Read more about this tip in PracticalOSINT's post:
practicalosint/analyze-any-x-twitter-profile-for-hidden-insights-using-my-f4a193c05e1d" rel="nofollow">https://medium.com/@practicalosint/analyze-any-x-twitter-profile-for-hidden-insights-using-my-f4a193c05e1d
The OSINT Essentials
One of the most unique collections of OSINT resources focused on finding information about people.
https://github.com/OSINTI4L/The-Kitchen-Sink/blob/main/OSINTials.md
Contributor OSINTI4L
#osint #socmint #geoint
GlimpseHG
View active Ads in Google, Linkedin and Meta (Facebook) for target domain. Free.
glimpsehq.io
Tip by twitter.com/HolismVision twitter.com/nononsenseintel
#osint
Orhyginal Maps
Select location on map and open info about it in 400+ maps/geodata tools and services.
- dozens of OSM maps
- transport/routring
- meteo
- history
- webcams
and more.
http://map.orhyginal.fr
#geoint
Great luck, If your investigative target is a doctor. Many countries have online registries of medical professionals with a lot of info. Ex:
🇮🇳nmc.org.in/information-desk/indian-medical-register/
🇺🇸find-doctor.ama-assn.org
🇬🇧gmc-uk.org/registration-and-licensing/our-registers
🇲🇾merits.mmc.gov.my/search/registeredDoctor
MEMERY
Very easy to install and use #python tool (with GUI) for text search of images in a local directory on your computer or server.
https://github.com/deepfates/memery
Creator twitter.com/deepfates
Files-Explorer
Do you use Google dork "intitle:index of site:*.yourtarget.com"?
This extension allows you to make viewing files in open directories more convenient. For example, it displays images as thumbnails without downloading them.
https://chromewebstore.google.com/detail/files-explorer/cmibdnmeihbjkdgnohgjeelkofcnfhid
Wayback Machine collection search
twitter.com/BanPangar shared a method for finding emails/nicknames mentions in the text of web pages/docs with archive.org collection search. Help find a lot of things that don't show up in Google results.
Don't forget the quotes.
#osint
MEMERY
Very easy to install and use #python tool (with GUI) for text search of images in a local directory on your computer or server.
https://github.com/deepfates/memery
Creator twitter.com/deepfates
superbolt.web.app
A new tool from GrayLark allows to geolocate a photo by very small details (a window corner, a trash can, a bush on the sidewalk, etc.).
So far only works for San Francisco, but many other cities are ahead.
#osint #geoint
Digital Methods Tools Archive
60+ free online tools for various highly specialized tasks in online investigations. For example:
- Wikipedia Edits IP Localizer
- Robots.txt Discovery
- Amazon Related Product Graph
and more.
https://wiki.digitalmethods.net/Dmi/ToolDatabase
Creator twitter.com/digitalmethods
Telegram Scraper
- scrape messages from multiple channels
- download media files
- export data to JSON/CSV formats
- SQLite database storage
(⚠️Telegram can ban for such tools, don't use accounts valuable to you for authorization)
https://github.com/unnohwn/telegram-scraper
Creator twitter.com/unnohwn
OSM Deep History
Click on a location on OpenStreetMap and select Query Features from the context menu to see the Node IDs of the associated elements (in the links)
Then copy the IDs to osmlab.github.io/osm-deep-history/ to see a history of changes (dates, name changes, usernames and more)
🇦🇺🇦🇺🇦🇺
Australian Public Data Sources
- people/business/licence plates/professional licenses/obituary/newspaper search
- web archives
- property history
- crime maps
and more.
https://osint.fans/australia-osint-data-sources
#osint
Google Earth Map Overlays
is a tool that makes it easy to combine Google Maps data with data from many other maps.
Download overlays: https://ge-map-overlays.appspot.com/
Make your own overlay from image: https://www.google.com/earth/outreach/learn/creating-photos-image-overlays-in-google-earth/
#osint #geoint
Mexico OSINT Tools
- public records
- government databases
- companies info
- geodata
and more.
https://substack.com/home/post/p-149884860
#osint
OSINT Tools Kazakhstan 🇰🇿🇰🇿🇰🇿
- Open Data portals
- Companies registries
- Venicle history
- Maps
- Public procurement portal
https://github.com/paulpogoda/OSINT-Tools-Kazakhstan Contributor /channel/pavelbannikov
Common Crawl Archive (https://commoncrawl.org) allows to get a saved copy of most pages on the internet for every week since October 2014 + less regular data since 2008.
Instructions on how to get started:
samuel.schaffhauser/using-the-common-crawl-as-a-data-source-693a41b3baa9" rel="nofollow">https://medium.com/@samuel.schaffhauser/using-the-common-crawl-as-a-data-source-693a41b3baa9
https://www.bellingcat.com/resources/2015/08/13/using-python-to-mine-common-crawl/
#python
17 Free/Partly Free Tools for Comprehensive Email Investigation
Telegram bots
Online tools
Email to Username tools
Google dorks for email search
https://osintteam.blog/explore-17-free-tools-for-in-depth-email-investigation-2a8fe6188451
by twitter.com/osinteam
#osint
Analyzing Email Headers and Content Using OSINT Tools by twitter.com/DeepWebOsint
Accessing Email Header Data
Analyzing Email Headers
Interpreting Information from Email Headers
Extracting and Analyzing URLs
Cross-Referencing IPs, Domains, and Hashes
https://theosintguide.com/2024/10/25/analyzing-email-headers-and-content-using-osint-tools/
Wikipedia Semantic Search
A search engine that does NOT look for word matches and does NOT generate answers using AI, but simply picks up relevant Wikipedia articles that potentially contain information related to the question.
wikipedia-semantic-search.vercel.app
Creator twitter.com/upstash
Free Clutch․co Scraper
Cluthch․co - major site for finding various services for business (350K+ service providers in 157 countries).
This simple tool allows to collect data from it into a CSV file in a couple of clicks.
https://thewebscrapingguy.com/free-tools/clutch-scraper
Creator twitter.com/adrian_horning_