curl help

[Ben Nash]

I'm trying to grab job listings from job sites like reed.com.

 

<?php
include("config.php");

echo"
<form action='index.php' method='POST' />
What: <input type='text' name='what' /> 
Where: <input type='text' name='where' />
<input type='submit' name='search' value='Search'/> 
</form>";

if (isset($_POST['search'])) {

$what = mysql_real_escape_string($_POST['what']);
$where = mysql_real_escape_string($_POST['where']);

if (empty($what) && (empty($where)))  {
echo"You need to enter info";
}else{

$curl = curl_init("http://www.reed.co.uk/jobs/$what-in-$where");
curl_setopt($curl, CURLOPT_RETURNTRANSFER, TRUE);

$page = curl_exec($curl);

curl_close($curl);

$regex = '/<p class="description">(.*?)<\/p>/s';
if ( preg_match($regex, $page, $list) )
   echo $list[0];

}

echo"<a href='http://www.reed.co.uk/jobs/$what-in-$where'>Continue</a>";

}

?>

 

This is my current code. If you enter info into the fields a link will appear for testing purposes, click on it and it will take you to reed. You will see the data entered at my site is all stuffed into the location field on reed. This is causing my site to display incorrect data... What am I doing wrong?

[Zettieee]

http://www.reed.co.uk/jobs/$where?keywords=$what

[Ben Nash]

That fixed the link but It's not displaying the full listing on my site. I have a strong belief this is the issue:

$regex = '/<p class="description">(.*?)<\/p>/s';

Edited April 2, 2014 by Ben Nash

[Djkanna]

That fixed the link but It's not displaying the full listing on my site. I have a strong belief this is the issue:

$regex = '/<p class="description">(.*?)<\/p>/s';

$url = 'http://www.reed.co.uk/jobs/'.$where.'?keywords='.$what;
$curl = curl_init ( $url );
curl_setopt($curl, CURLOPT_RETURNTRANSFER, TRUE);

$page = curl_exec($curl);

curl_close($curl);

$regex = '/<p class="description">(.*?)<\/p>/s';
if ( preg_match_all ( $regex, $page, $matches ) ) {
   $matches = $matches[0]; // Want the <p> ? no? use $matches[1]; then.
   foreach ( $matches as $key => $val ) {
       echo 'Match('.$key.'): '.htmlentities ( $val, ENT_QUOTES, 'UTF-8' ).' <br />';
   }
}

[Ben Nash]

Thanks Dj but it's just grabbing all the text. How do I output the html as well?

[Djkanna]

Thanks Dj but it's just grabbing all the text. How do I output the html as well?

It grabs what ever is in <p class="description"> and the p tag as per the regex.

If you want the p tag as html, remove the htmlentities [be careful].

[Ben Nash]

What I mean is how do I make it link back to reed? Also how to display the listings on my site in a tidy fashion? atm it's all jumbled... up

[BlackScorp]

it is not legal to crawl the webpage and parse the HTML Code.. if you want to use the search and data stuffs, therefore they made an API

http://www.reed.co.uk/api

[Script47]

I know this is a bit off topic, but you seem to be using MRES, now don't you think you should start using MySQLi or PDO seeing as MySQL is insecure and deprecated.

[BlackScorp]

I know this is a bit off topic, but you seem to be using MRES, now don't you think you should start using MySQLi or PDO seeing as MySQL is insecure and deprecated.

well he use it , but it is useless there, since he think he can escape values for the URL..

[Ben Nash]

I know mysql_real_escape_string is not needed there... It was for another part of the script I took out as it was unnecessary, just forgot to remove it.

[sniko]

it is not legal to crawl the webpage and parse the HTML Code.. if you want to use the search and data stuffs, therefore they made an API

http://www.reed.co.uk/api

Reiterating.