Reply to: What programming languages would you use for this example web development project?

[vetran]

VB6

the 42 of programming language!

[LondonManc]

Just use Endeca like Autotrader do.

[WHoSaidthis]

Do not reinvent the wheel, buy an off the shelf screen scraper software which does all the heavy lifting for you. Write some rudimentary C# web api to get data out of the database and bolt on a React front end. All of this can be done in a week if you have the skills.
would this project succeed in real life.? I doubt it. But then I doubted any of this comparison websites would make any money but here we are, they are making millions.

Thanks. It's like a zoo out there with screen scrapers. Have you personally used any or are close to any out there?

[WHoSaidthis]

The correct answer is python because parsing html comes out of the box. Yes it needs to go into a database as it should be searched. For images you can compare the size or even the name.

Sounds like a website that shows all the results of all the other websites doing the same thing. Copyright might be a problem there unless it's hosted in some far flung lawless land.

Thanks. Yes legalities are potentially a minefield.

If you do use autotrader - how could you get around the copyright issue? Only use some of the description? etc

[WTFH]

Without proper end to end tests this is unrealistic to be done in a week. Unless you want to deliver a product that has unsatisfactory performance.

Perhaps you could apply your rules to your posts.

[elsergiovolador]

Do not reinvent the wheel, buy an off the shelf screen scraper software which does all the heavy lifting for you. Write some rudimentary C# web api to get data out of the database and bolt on a React front end. All of this can be done in a week if you have the skills.
would this project succeed in real life.? I doubt it. But then I doubted any of this comparison websites would make any money but here we are, they are making millions.

Without proper end to end tests this is unrealistic to be done in a week. Unless you want to deliver a product that has unsatisfactory performance.

[Zigenare]

6502

Or if you can get hold of an ICL1900 series, PLAN.

[DimPrawn]

Do not reinvent the wheel, buy an off the shelf screen scraper software which does all the heavy lifting for you. Write some rudimentary C# web api to get data out of the database and bolt on a React front end. All of this can be done in a week if you have the skills.
would this project succeed in real life.? I doubt it. But then I doubted any of this comparison websites would make any money but here we are, they are making millions.

Where's the fun and invoicing potential in that?

I could turn this requirement into a 2 year project. Kerrrrching!

Oh, and you might want a new Sig.

[fullyautomatix]

Do not reinvent the wheel, buy an off the shelf screen scraper software which does all the heavy lifting for you. Write some rudimentary C# web api to get data out of the database and bolt on a React front end. All of this can be done in a week if you have the skills.
would this project succeed in real life.? I doubt it. But then I doubted any of this comparison websites would make any money but here we are, they are making millions.

[DimPrawn]

If the client is a big corporation do it in J2EE.

If the client is a small co, do it in Golang and store scraped data in Blockchain to get right keywords in your portfolio.

Top 10 IT Skills and Tech Skills for 2020 | Technojobs UK

I would use Python as the programming language.
I would host it in AWS.
I would use a Blockchain ledger database.
I would use Cyber Security to ensure the data is safe.
I would analyse the data using Data Science techniques
I would provide a UI/App using Mobile Development
I would provide IT Support
etc

[wattaj]

Pascal. Turbo Pascal if you're in a hurry.

[malvolio]

X

Sure that's not FORTH - the only language where you can use itself to redefine the instruction set and command syntax!

[elsergiovolador]

If the client is a big corporation do it in J2EE.

If the client is a small co, do it in Golang and store scraped data in Blockchain to get right keywords in your portfolio.

[NotAllThere]

X

[Paralytic]

COBOL