DM-53212: Add functions for getting full ccdVisit table and wide quicklook table#185
Open
mfisherlevine wants to merge 2 commits intomainfrom
Open
DM-53212: Add functions for getting full ccdVisit table and wide quicklook table#185mfisherlevine wants to merge 2 commits intomainfrom
mfisherlevine wants to merge 2 commits intomainfrom
Conversation
TallJimbo
approved these changes
Mar 20, 2026
| join_type="inner", | ||
| table_names=("vq", "v"), | ||
| uniq_col_name="{col_name}_{table_name}", # only duplicates get suffixed | ||
| ) |
Contributor
There was a problem hiding this comment.
I'm a little surprised you're doing this join with astropy instead of SQL.
Collaborator
There was a problem hiding this comment.
I really think it makes more sense to do this join with SQL.
Contributor
Author
There was a problem hiding this comment.
Looks like I can replace this with
vqCols = set(client.query("SELECT * FROM cdb_LSSTCam.visit1_quicklook LIMIT 0").colnames)
vCols = set(client.query("SELECT * FROM cdb_LSSTCam.visit1 LIMIT 0").colnames)
vOnlyCols = vCols - vqCols # exclude visit_id and all duplicates
selectClauses = ["vq.*"] + [f"v.{col}" for col in sorted(vOnlyCols)]
query = f"""
SELECT {', '.join(selectClauses)}
FROM cdb_LSSTCam.visit1_quicklook vq
INNER JOIN cdb_LSSTCam.visit1 v USING (visit_id)
WHERE vq.day_obs = {dayObs}
"""
return client.query(query)
Does that look reasonable to you, or am I still missing tricks?
Contributor
Author
There was a problem hiding this comment.
And was it just this function, or did you think the other one should have more things moved to SQL too?
Contributor
There was a problem hiding this comment.
That looks good to me, and think it was only this function.
da17fa5 to
bf8fa07
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.