Skip to content

Pull requests: basedosdados/pipelines

New pull request New
48 Open 1,235 Closed
48 Open 1,235 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Data] us_census_cog — onboard the U.S. Census of Governments (125.6M rows, 6 tables)
#2014 opened Sep 9, 2026 by rdahis Member Loading…
17
[Data] us_dot_fars — onboard the Fatality Analysis Reporting System (9.5M rows, 343 columns, 1975-2024) deploy-flow [PR] Dispara deploy dos flows alterados no work pool basedosdados-dev (Prefect 3 staging) table-approve [PR] Dispara Table Approve no merge
#2013 opened Sep 9, 2026 by rdahis Member Loading…
@rdahis
1
[Data] us_census_trade — onboard U.S. Census foreign trade (7 tables, HS6 monthly 2010+) deploy-flow [PR] Dispara deploy dos flows alterados no work pool basedosdados-dev (Prefect 3 staging)
#2012 opened Sep 9, 2026 by rdahis Member Loading…
8
[Fix] au_doe_higher_education — admit the WAF that blocks the annual download deploy-flow [PR] Dispara deploy dos flows alterados no work pool basedosdados-dev (Prefect 3 staging)
#2008 opened Sep 9, 2026 by rdahis Member Loading…
2 of 3 tasks
8
fix(us_dol_oflc): upload the table root so staging keeps its year= partitions deploy-flow [PR] Dispara deploy dos flows alterados no work pool basedosdados-dev (Prefect 3 staging)
#2006 opened Sep 9, 2026 by rdahis Member Loading…
2
feat(br_ms_sinasc): adiciona flow de carga anual, sem schedule deploy-flow [PR] Dispara deploy dos flows alterados no work pool basedosdados-dev (Prefect 3 staging)
#2003 opened Sep 8, 2026 by DaviMacielCavalcante Collaborator Loading…
1
@DaviMacielCavalcante
6
fix(us_dol_oflc): resolve the crosswalk by column layout, not by file name deploy-flow [PR] Dispara deploy dos flows alterados no work pool basedosdados-dev (Prefect 3 staging)
#1995 opened Sep 8, 2026 by rdahis Member Loading…
6
fix(utils): _sync_staging_schema usa o cliente autenticado da staging
#1980 opened Sep 4, 2026 by rdahis Member Loading…
4
feat(br_ms_sim): pipeline sob demanda, com os dados preliminares do DATASUS check-metadata [PR] Dispara validação de metadados entre BigQuery e API de produção deploy-flow [PR] Dispara deploy dos flows alterados no work pool basedosdados-dev (Prefect 3 staging) test-dev-model [PR] Roda testes DBT nos models modificados em basedosdados-dev
#1969 opened Sep 3, 2026 by DaviMacielCavalcante Collaborator Loading…
1
@DaviMacielCavalcante
16
[Data] br_ibge_censo_demografico 2022 public microdata conflict [PR] Conflito de merge a resolver data Nova base, conjunto ou tabela a ser adicionada à BD table-approve [PR] Dispara Table Approve no merge test-dev-model [PR] Roda testes DBT nos models modificados em basedosdados-dev
#1960 opened Sep 2, 2026 by JoaoCarabetta Contributor • Draft
6 of 10 tasks
1
2
Bug/br_ms_sih e br_ms_sia check-metadata [PR] Dispara validação de metadados entre BigQuery e API de produção deploy-flow [PR] Dispara deploy dos flows alterados no work pool basedosdados-dev (Prefect 3 staging)
#1941 opened Sep 1, 2026 by luizavboas Collaborator Loading…
3 tasks done
1
@luizavboas
5
feat(br_senatran_estatisticas): adiciona os seis recortes restantes da frota check-metadata [PR] Dispara validação de metadados entre BigQuery e API de produção deploy-flow [PR] Dispara deploy dos flows alterados no work pool basedosdados-dev (Prefect 3 staging) table-approve [PR] Dispara Table Approve no merge test-dev-model [PR] Roda testes DBT nos models modificados em basedosdados-dev
#1939 opened Sep 1, 2026 by rdahis Member Loading…
@rdahis
15
feat: pipeline orientado a eventos (check_update -> flow_download -> mat_test) conflict [PR] Conflito de merge a resolver
#1932 opened Aug 30, 2026 by Winzen Collaborator • Draft
5 tasks done
1
@Winzen
2
fix(auxiliary-files): serve bundles from the public, non-requester-pays bucket
#1928 opened Aug 28, 2026 by rdahis Member Loading…
@rdahis
10
fix(utils): never publish BD Pro rows to the open export
#1927 opened Aug 28, 2026 by rdahis Member Loading…
@rdahis
5
[Bugfix] materializa e testa em dev antes de escrever em prod conflict [PR] Conflito de merge a resolver
#1923 opened Aug 27, 2026 by rdahis Member Loading…
2 of 3 tasks
@rdahis
6
fix(metadata): let coverage ranges be created, and never invert the free range
#1921 opened Aug 27, 2026 by rdahis Member Loading…
@rdahis
11
fix(world_wb_mides): repair the models, split them per state, and stop table-approve materialising subdirectories table-approve [PR] Dispara Table Approve no merge
#1907 opened Aug 25, 2026 by rdahis Member Loading…
@rdahis
11
feat(br_sfb_sicar): cap deployment concurrency and offset schedule deploy-flow [PR] Dispara deploy dos flows alterados no work pool basedosdados-dev (Prefect 3 staging)
#1906 opened Aug 25, 2026 by rdahis Member Loading…
@rdahis
6
feat(diagnostics): mede custo de BigQuery por dataset e taxa real de ingestão
#1878 opened Aug 21, 2026 by rdahis Member Loading…
@rdahis
11
perf(dbt): limita os testes recorrentes à partição mais recente conflict [PR] Conflito de merge a resolver
#1877 opened Aug 21, 2026 by rdahis Member Loading…
@rdahis
5
[Data] us_treasury_usaspending: USAspending federal award transactions + monthly pipeline conflict [PR] Conflito de merge a resolver deploy-flow [PR] Dispara deploy dos flows alterados no work pool basedosdados-dev (Prefect 3 staging)
#1872 opened Aug 21, 2026 by rdahis Member Loading…
@rdahis
14
[Bugfix] _upload_to_gcs nunca pode apagar a tabela de produção
#1862 opened Aug 20, 2026 by rdahis Member Loading…
@rdahis
11
feat(world_cepii_baci): BACI international trade (HS92/HS17) + per-revision HS directories conflict [PR] Conflito de merge a resolver
#1791 opened Aug 12, 2026 by rdahis Member • Draft
@rdahis
2
[update]: Saeb 2025 check-metadata [PR] Dispara validação de metadados entre BigQuery e API de produção table-approve [PR] Dispara Table Approve no merge test-dev-model [PR] Roda testes DBT nos models modificados em basedosdados-dev
#1773 opened Aug 7, 2026 by aspeddro Collaborator • Draft
@aspeddro
1
ProTip! Follow long discussions with comments:>50.