• Visitors can check out the Forum FAQ by clicking this link. You have to register before you can post: click the REGISTER link above to proceed. To start viewing messages, select the forum that you want to visit from the selection below. View our Forum Privacy Policy.
  • Want to receive the latest contracting news and advice straight to your inbox? Sign up to the ContractorUK newsletter here. Every sign up will also be entered into a draw to WIN £100 Amazon vouchers!

test please delete

Collapse
This is a sticky topic.
X
X
  •  
  • Filter
  • Time
  • Show
Clear All
new posts

    Wikipedia entry on web crawling / spidering is here.

    Not sure if Nick has just downloaded it locally, or what - I considered seeing if there was some way that I could import the thread into a MySQL database on my laptop so that I could do some analysis / geek work with it.

    But I never got round to it.
    Best Forum Advisor 2014
    Work in the public sector? You can read my FAQ here
    Click here to get 15% off your first year's IPSE membership

    Comment


      Originally posted by BrilloPad View Post
      #100100
      BrilloPad
      Super poster

      century
      can we class those as a full house with 6 cards ???

      or is that a subject for Ask Brillo Pad in general
      Married

      Comment


        Originally posted by TheFaQQer View Post
        Basically, trawling the website, taking a copy of all the connecting pages. The homepage would be the centre of the web and then everything that links to the homepage is the first "ring" of the web. Everything that then links to the first layer of links becomes the next "ring" and so forth.

        It means that Nick has a copy of TPD somewhere, and so we can start to have some meaningful statistics measured easily

        So - starter for 10:

        - Top ten posters in a single day (e.g. TF posted 210 posts in a day once; BP posted 199 posts etc.)

        - Quickest gap between 000s

        - Most concurrent posts with the same timestamp (when was it, and was there a significant post looming at the time)
        I have been thinking all the avove for a while!

        And I expect an interface so I can just type "What is the Quickest gap between 000s?" - I dont want to do any sql or any rubbish like that!

        I know NF is up to it...

        Comment


          Originally posted by FiveTimes View Post
          I'll give your "special" cakes a miss thanks
          They are all gone now anyway - did not last long!

          Comment


            Originally posted by BrilloPad View Post
            They are all gone now anyway - did not last long!
            Im hungry...
            Bazza gets caught
            Socrates - "The only true wisdom is in knowing you know nothing."

            CUK University Challenge Champions 2010

            Comment


              Originally posted by BrilloPad View Post
              I have been thinking all the avove for a while!

              And I expect an interface so I can just type "What is the Quickest gap between 000s?" - I dont want to do any sql or any rubbish like that!

              I know NF is up to it...
              Not sure that you can just type that and it will work

              A list of frequently asked statistics would be good to implement, plus maybe just a nice query only front end to run your own? I like geeky things like this
              Best Forum Advisor 2014
              Work in the public sector? You can read my FAQ here
              Click here to get 15% off your first year's IPSE membership

              Comment


                Originally posted by cailin maith View Post
                Im hungry...
                Just had some biscuits. There are some choccies in the usual place if you want them
                Best Forum Advisor 2014
                Work in the public sector? You can read my FAQ here
                Click here to get 15% off your first year's IPSE membership

                Comment


                  Originally posted by cailin maith View Post
                  Im hungry...

                  That's a good sign........
                  It's Deja-vu all over again!

                  Comment


                    Originally posted by TheFaQQer View Post
                    Just had some biscuits. There are some choccies in the usual place if you want them
                    Helpful

                    Originally posted by KathyWoolfe View Post
                    That's a good sign........
                    Thanks Kathy, I think so too.... but I'm afraid to eat in case I puke again

                    Maybe dry toast... thats what mammy reccomended..
                    Bazza gets caught
                    Socrates - "The only true wisdom is in knowing you know nothing."

                    CUK University Challenge Champions 2010

                    Comment


                      Originally posted by cailin maith View Post
                      Helpful



                      Thanks Kathy, I think so too.... but I'm afraid to eat in case I puke again

                      Maybe dry toast... thats what mammy reccomended..
                      What would she know? Try 6 pints of Mild and a Lamb Jalfrezi
                      The squint, the cocked eye and clenched first are the cornerstones of all Merseyside communication from birth to grave

                      Comment

                      Working...
                      X