Archive: curl

Posts Tagged ‘curl’

Curl 404 but Fine in Browser + Solution

May 19, 2009 No Comments

I just hit an intriguing situation where a page that was perfectly viewable in my browser was not visible via curl.
I scratched my head and messed around testing the page in variety of online proxy services and local web browsers. I even stared messing about with telnet and manually typing headers. My conclusion was [...]

scraping, By: admin
Tags: 404, curl, gzip

Building Spiders: Grab Data, Post Forms and Interact with Web Sites Automatically

February 14, 2008 3 Comments

One of the most useful and powerful things you can do with PHP is to create a programme which will simulate a web browser and can grab data, post data to forms and generally interact with other web sites - automatically.
For PHP to be able to work like this it must have the CURL library [...]

curl, firefox, php, programming, spidering, By: admin
Tags: addon, curl, firefox, get, headers, http, mysql, php, post, screen scraping, spider, spidering

Categories:

Archive by date:

Got any questions?

Send us a message or call us on 0844 357 0201

Edmonds Commerce offers Freelance PHP development work. Being based in Baildon Which is in between Leeds and Bradford in West Yorkshire, we are located right in the heart of the UK and can offer our services to any UK business looking for ecommerce, oscommerce or PHP development work.