Unable to apply Django migration in Postgres DB

Question

In Django app, I'm using Postgres DB. I have two tables where one of them has 76 million records and the other 8.2 million.

I have created a new migration file where in I'm adding a new column to a table in an app and setting default value to 0.

My database is hosted on Ubuntu EC2 instance which has RAM of 8 GB.

When I try to apply the migration using python manage.py migrate app_name migration_file_name, it's throwing below error:

File "/usr/local/lib/python2.7/site-packages/django/db/backends/utils.py", line 64, in execute return self.cursor.execute(sql, params) django.db.utils.OperationalError: SSL SYSCALL error: EOF detected

I have gone through this solution Postgres SSL SYSCALL error: EOF detected with python and psycopg But not sure if it's memory issue or something else.

Python: 2.7.12
Django 1.11.15
Ubuntu: 18.04
Postgres DB: 10.7

What else could be the issue?

George V The Developer · Accepted Answer · 2020-03-21 22:23:41Z

3

Your query might too large - too many operations. This causes the system to run out of memory.

answered Mar 21, 2020 at 22:23

George V The Developer

918 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

J-E Casta · Accepted Answer · 2021-05-10 14:00:02Z

-1

Adding new column with default value trig a table reconstruction. To avoid that with big table, you can create you migrations in 3 times.

Firstly, Create a migration file to add NULLABLE column without default value.
Secondly, Create an empty migration that fill this new empty value with excepting default value to all instance with null=True
Thirdly, Create a migration that define your column is not nullable with a defaut value

answered May 10, 2021 at 14:00

J-E Casta

1967 bronze badges

Collectives™ on Stack Overflow

Unable to apply Django migration in Postgres DB

2 Answers 2

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related