VERY BREAKING: Rename data and operations schemas by MoralCode · Pull Request #353 · chaoss/CollectOSS

MoralCode · 2026-05-29T14:14:50Z

Description
This PR renames the two core schemas CollectOSS uses

augur_data -> collection_data
augur_operations -> collection_operations

This change will be breaking for any downstream uses of the old CollectOSS schema names

The database migration included here is just an ALTER SCHEMA query and some small adjustments to existing schema comments - it is fully/losslessly reversible in case it is found to cause issues

This PR fixes #324

Notes for Reviewers

Signed commits

Yes, I signed my commits.

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

…tion) Signed-off-by: Adrian Edwards <adredwar@redhat.com>

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

github-advanced-security

Bandit found more than 20 potential problems in the proposed changes. Check the Files changed tab for more details.

github-actions · 2026-05-29T14:15:30Z

 def get_user_repos(connection):

-    return connection.execute(s.text("""SELECT * FROM "augur_operations"."user_repos";""")).fetchall()
+    return connection.execute(s.text("""SELECT * FROM "collection_operations"."user_repos";""")).fetchall()


[pylint] _{reported by reviewdog 🐶}
E0602: Undefined variable 's' (undefined-variable)

github-actions · 2026-05-29T14:15:30Z

-            connection.execute("""DELETE FROM augur_operations.config""")
+            connection.execute("""DELETE FROM collection_operations.config""")

 def test_get_config_key_with_none_specified(key_handler, test_db_engine):


[pylint] _{reported by reviewdog 🐶}
W0621: Redefining name 'key_handler' from outer scope (line 22) (redefined-outer-name)

github-actions · 2026-05-29T14:15:30Z

@@ -9,11 +9,11 @@
 @pytest.fixture
 def set_up_repo_groups(database_connection):


[pylint] _{reported by reviewdog 🐶}
W0621: Redefining name 'database_connection' from outer scope (line 2) (redefined-outer-name)

github-actions · 2026-05-29T14:15:30Z

 def set_up_repo_groups(database_connection):

-    df = pd.read_sql(s.sql.text("SELECT repo_group_id FROM augur_data.repo_groups"), database_connection)
+    df = pd.read_sql(s.sql.text("SELECT repo_group_id FROM collection_data.repo_groups"), database_connection)


[pylint] _{reported by reviewdog 🐶}
E0602: Undefined variable 's' (undefined-variable)

github-actions · 2026-05-29T14:15:30Z

+    df = pd.read_sql(s.sql.text("SELECT repo_group_id FROM collection_data.repo_groups"), database_connection)
    repo_group_IDs = df['repo_group_id'].values.tolist()

    insert_repo_group_sql = s.sql.text("""


[pylint] _{reported by reviewdog 🐶}
E0602: Undefined variable 's' (undefined-variable)

github-actions · 2026-05-29T14:15:30Z


    repo_group_IDs = [group[0] for group in df.fetchall()]

    insertSQL = s.sql.text("""


[pylint] _{reported by reviewdog 🐶}
E0602: Undefined variable 's' (undefined-variable)

github-actions · 2026-05-29T14:15:30Z

@@ -12,7 +12,7 @@ def poll_database_connection(database_string):
    print("Attempting to create db engine")

    db = s.create_engine(database_string, poolclass=s.pool.NullPool,


[pylint] _{reported by reviewdog 🐶}
E0602: Undefined variable 's' (undefined-variable)

github-actions · 2026-05-29T14:15:30Z

@@ -12,7 +12,7 @@ def poll_database_connection(database_string):
    print("Attempting to create db engine")

    db = s.create_engine(database_string, poolclass=s.pool.NullPool,


[pylint] _{reported by reviewdog 🐶}
E0602: Undefined variable 's' (undefined-variable)

github-actions · 2026-05-29T14:15:30Z

+        self.db_schema = 'collectoss_data'
+        self.helper_schema = 'collection_operations'

        self.helper_db = s.create_engine(DB_STR, poolclass=s.pool.NullPool,


[pylint] _{reported by reviewdog 🐶}
E0602: Undefined variable 's' (undefined-variable)

github-actions · 2026-05-29T14:15:30Z

+        self.db_schema = 'collectoss_data'
+        self.helper_schema = 'collection_operations'

        self.helper_db = s.create_engine(DB_STR, poolclass=s.pool.NullPool,


[pylint] _{reported by reviewdog 🐶}
E0602: Undefined variable 's' (undefined-variable)

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

MoralCode added 24 commits May 27, 2026 15:51

rename augur_data model file to data

98cee3e

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

rename augur_data to collection_data in schema arguments

86e260b

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

rename augur_data to collection_data in table arguments

9d907f2

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

schema arguments (but single quotes this time)

e637771

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

rename all references (foreign keys, sequences etc) within SQL

bf798ea

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

rename all references to augur_data in the rest of the codebase

cea59b8

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

rename augur_operations file to operations

cf6b651

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

rename operations schema specifiers in tables and columns

5ddd115

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

rename in-SQL references to operations schema within the models

56627b6

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

rename all references to augur_operations in the rest of the codebase

2fc2d6e

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

create database migration for the schema rename

2c11dad

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

correct more imports of the ops schema

ba45cb1

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

fix search paths

419d3df

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

update test fixtures for worker tests

f275c2b

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

update unit test references to operations schema in SQL

e410cfc

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

update docs references to ops schema by name

68d9d70

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

update database comments (and include them in the schema rename migra…

e532006

…tion) Signed-off-by: Adrian Edwards <adredwar@redhat.com>

update another schema reference in tests

cd47c36

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

forgot to change augur_data model imports

63e768d

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

rename a schema reflection ref that was crashing gunicorn

ca62e36

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

rename an augur_data variable

89f623a

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

change augur_data references in test files

5ca88b8

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

change augur_data references in docs files

eaa6057

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

change augur_data references in the CLI

488b8a8

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

github-advanced-security AI found potential problems May 29, 2026

View reviewed changes

github-actions Bot reviewed May 29, 2026

View reviewed changes

MoralCode added this to the v1.1 Migration Release milestone May 29, 2026

MoralCode added the database Related to the unifed data model/schema label May 29, 2026

MoralCode added 2 commits May 29, 2026 11:51

fix typo (its collection_data schema)

fca0f63

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

hardcode schema in migrations

83ab6a4

Signed-off-by: Adrian Edwards <adredwar@redhat.com>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

VERY BREAKING: Rename data and operations schemas#353

VERY BREAKING: Rename data and operations schemas#353
MoralCode wants to merge 26 commits into
mainfrom
rename/schema

MoralCode commented May 29, 2026 •

edited

Loading

Uh oh!

github-advanced-security AI left a comment

Uh oh!

github-actions Bot May 29, 2026

Uh oh!

github-actions Bot May 29, 2026

Uh oh!

github-actions Bot May 29, 2026

Uh oh!

github-actions Bot May 29, 2026

Uh oh!

github-actions Bot May 29, 2026

Uh oh!

github-actions Bot May 29, 2026

Uh oh!

github-actions Bot May 29, 2026

Uh oh!

github-actions Bot May 29, 2026

Uh oh!

github-actions Bot May 29, 2026

Uh oh!

github-actions Bot May 29, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

		@@ -9,11 +9,11 @@
		@pytest.fixture
		def set_up_repo_groups(database_connection):


		repo_group_IDs = [group[0] for group in df.fetchall()]

		insertSQL = s.sql.text("""

		@@ -12,7 +12,7 @@ def poll_database_connection(database_string):
		print("Attempting to create db engine")

		db = s.create_engine(database_string, poolclass=s.pool.NullPool,

Conversation

MoralCode commented May 29, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-advanced-security AI left a comment

Choose a reason for hiding this comment

Uh oh!

github-actions Bot May 29, 2026

Choose a reason for hiding this comment

Uh oh!

github-actions Bot May 29, 2026

Choose a reason for hiding this comment

Uh oh!

github-actions Bot May 29, 2026

Choose a reason for hiding this comment

Uh oh!

github-actions Bot May 29, 2026

Choose a reason for hiding this comment

Uh oh!

github-actions Bot May 29, 2026

Choose a reason for hiding this comment

Uh oh!

github-actions Bot May 29, 2026

Choose a reason for hiding this comment

Uh oh!

github-actions Bot May 29, 2026

Choose a reason for hiding this comment

Uh oh!

github-actions Bot May 29, 2026

Choose a reason for hiding this comment

Uh oh!

github-actions Bot May 29, 2026

Choose a reason for hiding this comment

Uh oh!

github-actions Bot May 29, 2026

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

MoralCode commented May 29, 2026 •

edited

Loading