• Want to receive the latest contracting news and advice straight to your inbox? Sign up to the ContractorUK newsletter here. Every sign up will also be entered into a draw to WIN £100 Amazon vouchers!

data mining

You're going to annoy people if you carry on cross-posting like this. You may not like the answers people have given in the other forum, but that's no reason to post (more or less) the same question here. It's the same people that read this forum.

There's no off the self software available to do what you're asking. You will need to get somebody technical involved as Spacecadet has already offered to do.
 
You could have a look at Teleport Pro or similar web-site crawling tools, but unless you're technical you're going to end up in a mess.
 
It's pretty simple in excel ;)

Code:
Sub get_data()
 
i = 1
Do While i < 20000


strg = "URL;http://www.jobserve.com/RecruiterDirectoryListing.aspx?id=" & i
 With Sheet3.QueryTables.Add(Connection:= _
        strg, Destination:=Sheet3.Cells(1, 1))
        .Name = "RecruiterDirectoryListing.aspx?id=" & i
        .FieldNames = True
        .RowNumbers = False
        .FillAdjacentFormulas = False
        .PreserveFormatting = True
        .RefreshOnFileOpen = False
        .BackgroundQuery = True
        .RefreshStyle = xlInsertDeleteCells
        .SavePassword = False
        .SaveData = True
        .AdjustColumnWidth = True
        .RefreshPeriod = 0
        .WebSelectionType = xlSpecifiedTables
        .WebFormatting = xlWebFormattingNone
        .WebTables = "7"
        .WebPreFormattedTextToColumns = True
        .WebConsecutiveDelimitersAsOne = True
        .WebSingleBlockTextImport = False
        .WebDisableDateRecognition = False
        .WebDisableRedirections = False
        .Refresh BackgroundQuery:=False
    End With
    
Sheet2.Cells(i, 1).Value = Sheet3.Cells(4, 2).Value
Sheet3.Range("a1:e10").Delete
i = i + 1

Loop
End Sub


Gets the first 20000 for you anyways but I'm sure one of the techies can improve on it
HTH
 
Wouldn't it be illegal or some breach of copywrite? I seem to recall that yell.com got the hump over people doing a similar thing with their online data and (possibly, for I do have brains of jam and a memory to match) successfully sued.

Nice bit of VBA though, duly filed...
 
Wouldn't it be illegal or some breach of copywrite? I seem to recall that yell.com got the hump over people doing a similar thing with their online data and (possibly, for I do have brains of jam and a memory to match) successfully sued.

Yes - Jobserve have a clause in their T's & C's that specifically warns against doing this.
 

Advertisers

Back
Top