# Introduction

> Welcome to the Emlak Crawler documentation.

**Emlak Crawler** is an automated real estate scraper built with .NET 10. It collects property listings from bina.az, lalafo.az, yeniemlak.az, unvan.az, and vipemlak.az, removes duplicates, filters out real estate agents using emlak-bazasi.com, and schedules WhatsApp messages to property owners through WasenderAPI.

<Callout type="info" title="Core Purpose">
  Automatically detect newly published owner listings, normalize property data, and deliver verified leads to the sales team.
</Callout>

## What you can do

<CardGroup cols={1}>
  <Card title="Collect listings" icon="magnifying-glass">
    Scrape new property listings from five Azerbaijani real estate portals on a schedule.
  </Card>

  <Card title="Filter and clean data" icon="funnel">
    Remove duplicate listings, normalize property data, and exclude real estate agents.
  </Card>

  <Card title="Reach owners" icon="chat-bubble-left-right">
    Schedule WhatsApp messages to direct owners and deliver verified leads to the sales team.
  </Card>
</CardGroup>

## How it works

1. **Scrape:** Collect new listings from bina.az, lalafo.az, yeniemlak.az, unvan.az, and vipemlak.az.
2. **Normalize:** Convert each listing into a consistent property record.
3. **Deduplicate:** Merge listings that describe the same property.
4. **Filter:** Check each poster against emlak-bazasi.com and drop real estate agents.
5. **Schedule:** Queue WhatsApp messages to the remaining owners through WasenderAPI.
6. **Deliver:** Send verified leads to the sales team.
