Batch Processing in MySQL and PHP?

Question

I am making an application in which once a week will have to perform multiple operations (calculations) based on all users of the system. Initially estimated about 300 users.

My question is, is there a method to perform this type of operation? like batch processing? At this moment, I test the script with only an user and on my localhost, I use a foreach cycle to cycle users and made all queries, calculations and insert the results ..

I have the doubt if more users saturate the script or hosting or similar things.. How can i handle such situations?

Cheers ;)

PDO + dev.mysql.com/doc/refman/5.0/en/commit.html

Wesley Schleumer de Góes
– Wesley Schleumer de Góes

2013-06-11 13:59:51 +00:00
Commented Jun 11, 2013 at 13:59 — Wesley Schleumer de Góes
– Wesley Schleumer de Góes, Commented Jun 11, 2013 at 13:59
Cron jobs is you best option! See this answer

Daniel Wondyifraw
– Daniel Wondyifraw

2015-10-22 16:35:16 +00:00
Commented Oct 22, 2015 at 16:35 — Daniel Wondyifraw
– Daniel Wondyifraw, Commented Oct 22, 2015 at 16:35

eMko · Accepted Answer · 2013-06-11 14:08:16Z

1

This kind of situation is usually done with Cron (or something similiar on Windows). So if your script is run only by cron in off-peak hours (e.g. 3am on Sunday if all your users are in one timezone), you are almost certain that it neither run twice in the same time nor does affect your users.

Since MySQL supports transaction and stored procedures and functions, I would recommend you to use stored procedure in database rather than PHP script for looping through data. You can then store logic in db functions and do something like insert-select in a transaction. It should be faster, safer and more convenient way than plain loop.

answered Jun 11, 2013 at 14:08

eMko

1,1439 silver badges22 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Batch Processing in MySQL and PHP?

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related