1. Executive Summary & Scope
Crawlexa (“we”, “us”, or “our”) provides managed web data harvesting, public ecommerce catalog crawling, and alternative data feeds for business enterprises. We fundamentally operate as a public data intelligence infrastructure.
This Privacy Policy explains how Crawlexa handles information in two separate contexts:
- Commercial Client Information: Account credentials, business contact emails, billing identifiers, and pipeline scoping requirements provided by our clients.
- Harvested Web Information: Publicly available web data (e.g., product prices, stock status, ratings, specifications, real estate listings) collected on behalf of our enterprise clients.
2. Strict Prohibition of Personally Identifiable Information (PII)
Our automated ingestion filters include real-time regex sanitizers that detect and immediately redact accidentally encountered personal identifiers (such as personal phone numbers, email addresses, social security numbers, and private consumer identifiers) before dataset serialization.
3. Legal Basis for Public Web Data Extraction
Crawlexa collects web data based on recognized international legal frameworks:
- GDPR (General Data Protection Regulation - EU): Under Article 6(1)(f), public market intelligence and price transparency constitute a recognized “Legitimate Interest,” provided it does not infringe upon the fundamental rights of individuals.
- United States Precedent (CFAA & hiQ Labs v. LinkedIn): Confirmed that scraping publicly accessible web data that is not behind a password, paywall, or authentication barrier does not violate the Computer Fraud and Abuse Act.
- CCPA / CPRA (California Consumer Privacy Act): Excludes publicly available information from the scope of personal consumer records.
4. Client Account Data Collection & Use
When you register, request a sample dataset, or communicate with our engineering teams, we collect:
- Contact Information: Work email, company name, phone number, and technical representative name.
- Pipeline Specifications: Target domains, required schema fields, volume estimates, and destination endpoints (e.g. S3 buckets, BigQuery datasets).
- Communications: Direct inquiries forwarded to our sales desk at
sales@crawlexa.comor via+91 8160867884.
We strictly use client data to fulfill scoping agreements, deliver sample feeds, maintain extraction pipelines, and process billing. We do not sell, rent, or trade client account information to third-party data brokers.
5. Data Retention, Storage & Encryption
Client datasets stored on staging servers are governed by strict lifecycle management:
- At Rest: All database volumes and temporary extraction staging buckets are encrypted using military-grade AES-256 encryption.
- In Transit: Data transmitted via API, webhooks, or cloud sync is protected by TLS 1.3 / HTTPS with modern cipher suites.
- Staging Retention: Production harvest samples and temporary payloads are automatically purged after 30 days unless client contract agreements specify dedicated cold archive storage.
6. Your Data Rights & Webmaster Opt-Out
Whether you are a commercial client or a webmaster with questions about automated crawling on your public platform, you have the right to:
- Request confirmation of whether your business contact details are held by Crawlexa.
- Request permanent deletion of your business inquiry or sample scope history.
- Request crawler throttling, IP identification, or exclusion of specific URLs from automated research crawlers.
To exercise any of these rights, contact our Data Protection Officer directly at privacy@crawlexa.com or telephone +91 8160867884. We acknowledge all data subject requests within 48 business hours and fulfill statutory access or deletion requests within standard regulatory windows (30 days under GDPR, 45 days under CCPA). General sales inquiries continue to receive response within 4 business hours.