Installing Every Firefox Extension: A Technical Odyssey

With over 84,000 Firefox extensions available, I embarked on an ambitious project to scrape and install them all. The journey began with the realization that the public API of the add-ons store allowed for extensive data retrieval without authentication or rate limits. Initially, I could only access 30,000 extensions due to API limitations, but by experimenting with different sorting parameters and using exclusion techniques, I managed to gather data on over 68,000 extensions.

To overcome the limitations of the API, I utilized various sorting methods like 'created', 'rating', and 'hotness'. This approach, combined with fetching pages in parallel and filtering by categories, allowed me to compile a comprehensive dataset of 84,235 unique extensions, which I uploaded to Hugging Face for public access.

The analysis of these extensions revealed fascinating insights. The largest extension, Dmitlichess, was a whopping 196.3 MB, while the smallest was a mere 7518 bytes. I also discovered extensions with dubious intentions, such as phishing attempts disguised as legitimate tools, and SEO spam extensions linking to random websites.

In terms of user engagement, a significant portion of extensions had no daily users, while a small percentage boasted over 10,000 daily users. Interestingly, 76.7% of extensions were open source, and a surprising 38.1% of those required payment.

The installation process was not without its challenges. My initial attempts to install all extensions simultaneously led to system crashes and unresponsive browsers. By gradually increasing the number of installed extensions, I found that Firefox could handle up to 6,000 extensions before performance degraded significantly.

Despite the technical hurdles, I managed to run Firefox with all 84,194 extensions installed, albeit with severe performance issues. This experiment highlighted the limitations of current browser architectures when handling such a massive number of extensions.

The project also uncovered patterns in extension development and distribution, such as prolific developers like Dr. B, who published 84 extensions, and companies like Innover Online Group Ltd, which used extensions as a vehicle for affiliate marketing.

Ultimately, this endeavor not only provided a comprehensive dataset of Firefox extensions but also offered a glimpse into the diverse and sometimes questionable ecosystem of browser add-ons.