Welcome to my custom-built PHP Web Scraper, a lightweight and efficient tool designed to demonstrate my expertise in PHP development and REST API creation. This project highlights my ability to deliver clean, functional code tailored for educational or proof-of-concept needs.
robots.txt guidelines before use.
This scraper extracts the title and meta description from any webpage provided via a URL parameter. It’s built with PHP and integrates rate-limiting features to ensure responsible usage, making it a great example of my skills in backend development and API design.
?url=https://example.comTest the scraper in action with this deployed REST API: Kindly Note that i have not disclosed the server URL here to avoid somebody using this in unintended ways. I can share the demo URLs with my clients separately by email. Thank you.
Example Request:
*Demo Warning:* For testing purposes only. Please do not scrape live sites without their consent.
The source code for this project is in GitHub : Scraper GitHub repo. Note that currently code is private and i can share it with my clients
This project uses PHP to fetch and parse webpage data, with a MySQL database to track usage limits. Below are the setup requirements if you’d like to reuse or customize this code:
Update the following line in the code with your MySQL credentials:
$conn = new mysqli("127.0.0.1", "username", "password", "database");
scrape_limitapp_id (INT)validation_date (DATE)ip_address (TEXT, 15 length)scrape_url (TEXT, 50 length)count (INT)Interested in this project or need a custom solution? I’d love to hear from you! Reach out via:
As a freelancer, I specialize in PHP development, API creation, and database-driven applications. Let’s collaborate to bring your ideas to life!