Skip to content

fix: SparkSQLCompare forbid case sensitive columns#508

Merged
fdosani merged 3 commits intocapitalone:developfrom
sh13m:SparkSQLCompare-no-case-sensitive-cols
Apr 1, 2026
Merged

fix: SparkSQLCompare forbid case sensitive columns#508
fdosani merged 3 commits intocapitalone:developfrom
sh13m:SparkSQLCompare-no-case-sensitive-cols

Conversation

@sh13m
Copy link
Copy Markdown

@sh13m sh13m commented Apr 1, 2026

Addresses #506.

  • Based on Spark's best practices, explicitly disallow case sensitive columns when comparing dataframes with cast_column_names_lower=False.

@fdosani fdosani merged commit fb1cf5f into capitalone:develop Apr 1, 2026
18 checks passed
@sh13m sh13m deleted the SparkSQLCompare-no-case-sensitive-cols branch April 1, 2026 02:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants