OSINT on Usenet
This document is a work in progress.
Introduction
The purpose of this guide is to give a general introduction to what is Usenet, why is it important, and how to perform OSINT on it.
What is Usenet?
Usenet is a decentralized, worldwide, peer-to-peer system for circulating messages between users.
A little terminology:
- Usenet: A worldwide distributed discussion system that operates on a purely peer-to-peer basis.
- Newsgroups: Discussions forums on Usenet. Newsgroups can either be moderated or unmoderated. An example of a newsgroup would be the alt.fan.usenetnewsgroup.
- Binary Newsgroups Many newsgroups in the alt.* hierarchy are binary groups and are very active for filesharing. In the past, this caused a major disruption to Usenet as many providers dropped Usenet as a service. Not onlywere copyrighted materials being shared but so was child pornography. ManyUsenet servers will not carry binary newsgroups, though most paid servicesstill do.
- Text Newsgroups The overwhelming majority of discussions take place on text newsgroups. Text newsgroups are just plain text. If you download a news article from a text newsgroup, it will only contain plain text which makes it very useful for searching and organizing.
- Articles: Messages or posts on newsgroups are known as articles.
- Hierarchies: Groups of newsgroups. These may be unmanaged such as the alt.* and free.* hierarchies or they may be managed by volunteer organizations. Many hierarchies are geographically specific. In the past, many hierarchies were run by corporations such as Microsoft and Novell, but those have become disused over time.
- The Big-8: The Big-8 is a collection of hierarchies that are the decedents of the original hierarchies that have been with Usenet since the very beginning. Many newsgroups still have active communities.
- Servers: Usenet servers are what make up the Usenet. They are run by hobbyists and non-profit organizations or by companies that sell access. Hobbyists and non-profits typically do not carry binary newsgroups. While they do not outwardly advertise this fact, Usenet access companies focus on providing access as a means for filesharing.
Why is Usenet Important?
While Usenet was originally developed in the late 1970s and early 1980s,it is still an active network with hundreds of servers worldwide that operate in a purely peer-to-peer manner. Usenet does not have any kind of top-down structure. Server administrators decide for themselves what newsgroups they want to carry on their servers. Many newsgroups and entire hierarchieshave been dormant for years. That doesn’t mean that there isn’t any activity there, it just means that it is far less than it was in its heyday.