Skip to content

Enable server side cursors #46166

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 4 commits into from
Closed

Conversation

J0
Copy link

@J0 J0 commented Feb 27, 2022

The old PR went stale and I ended up busy for a year so had to re-open in a new branch. Hoping to finally push this through

This pull request attempts to fix #35689. I read an article by @itamarst and decided to look further into the codebase. After noticing that the fix semed to be simple I decided file a PR. The fix is naive and I'm not sure the true solution is as simple as I imagine it to be. There are probably many things I'm missing as I've not read the codebase in detail so do let me know what else needs to be addressed.

Sorry, something went wrong.

Joel Lee added 2 commits February 27, 2022 14:43

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
@J0 J0 mentioned this pull request Feb 27, 2022
4 tasks
@jreback jreback added the IO SQL to_sql, read_sql, read_sql_query label Feb 27, 2022
Copy link
Contributor

@jreback jreback left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is this exercised in any current tests?

does the doc-string need updating here?

def execute(self, *args, **kwargs):
"""Simple passthrough to SQLAlchemy connectable"""
return self.connectable.execution_options().execute(*args, **kwargs)
def execute(self, chunksize: int = 0, *args, **kwargs):
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you add a return type

Copy link
Author

@J0 J0 Mar 1, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Will do! Will also add references to relevant tests and add a test if needed

@github-actions
Copy link
Contributor

github-actions bot commented Apr 1, 2022

This pull request is stale because it has been open for thirty days with no activity. Please update and respond to this comment if you're still interested in working on this.

@github-actions github-actions bot added the Stale label Apr 1, 2022
@pep8speaks
Copy link

Hello @J0! Thanks for updating this PR. We checked the lines you've touched for PEP 8 issues, and found:

Line 1394:1: W293 blank line contains whitespace

@mroeschke
Copy link
Member

Thanks for the pull request, but it appears to have gone stale. If interested in continuing, please merge the main branch, address the review comments, and we can reopen.

@mroeschke mroeschke closed this Apr 24, 2022
@gregorywaynepower
Copy link

@J0 Is this still being worked on?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
IO SQL to_sql, read_sql, read_sql_query Stale
Projects
None yet
Development

Successfully merging this pull request may close these issues.

ENH: Support PostgreSQL server-side cursors to prevent memory hog on large datasets
5 participants