[Webinar] How to Boost Your Sales on Social Media 🛍

Join this webinar to discover effective ways to drive traffic and boost sales.

Save your seat

Published February 8th 2012

Brandwatch Experts: 2. Crawling the Web

We’re fortunate to have a team of very smart people behind Brandwatch. As you can imagine, there’s a lot going on behind the scenes here to gather, analyse and present the data data you see in the webapp.

So to fill you in on what some of them are up to and how they are aiding our constant strive to provide the best social media monitoring solution possible, we held a series of interviews with some of the staff. Following our first interview with Xinglong about sentiment analysis and NLP, here’s number two of the series!

2. Dr. Tim Owen – Head of Backend Development

Tim heads up our team of backend developers. We asked Tim several questions about how Brandwatch gathers data from the web, what makes that approach unique and why it benefits our clients:


1. Where does the data in Brandwatch come from? (00:28)
2. How do Brandwatch’s crawlers know where to look? (01:07)
3. How much data does Brandwatch store? (01:52)
4. Where is all the data stored? (02:13)
5. How far back does Brandwatch have data from? (02:53)
6. How does Brandwatch crawl Facebook? (03:13)
7. What are the benefits of Brandwatch’s crawling flexibility? (04:03)

Share this post
Brandwatch Bulletin

Offering up analysis and data on everything from the events of the day to the latest consumer trends. Subscribe to keep your finger on the world’s pulse.

Get the data
facets Created with Sketch.
facets-bottom Created with Sketch.
New: Consumer Research

Harness the power of digital consumer intelligence

Consumer Research gives you access to deep consumer insights from 100 million online sources and over 1.4 trillion posts.

Falcon.io is now part of Brandwatch.
You're in the right place!

Existing customer?Log in to access your existing Falcon products and data via the login menu on the top right of the page.New customer?You'll find the former Falcon products under 'Social Media Management' if you go to 'Our Suite' in the navigation.

Paladin is now Influence.
You're in the right place!

Brandwatch acquired Paladin in March 2022. It's now called Influence, which is part of Brandwatch's Social Media Management solution.Want to access your Paladin account?Use the login menu at the top right corner.