Migrated Dossier data ingestion in InfobloxCloudDataConnector to the Log Ingestion API (DCE/DCR) - #14941
Open
devendra-chavda wants to merge 2 commits into
Open
Migrated Dossier data ingestion in InfobloxCloudDataConnector to the Log Ingestion API (DCE/DCR)#14941devendra-chavda wants to merge 2 commits into
devendra-chavda wants to merge 2 commits into
Conversation
…Log Ingestion API (DCE/DCR)
Contributor
There was a problem hiding this comment.
Pull request overview
Note
Copilot was unable to run its full agentic suite in this review.
Migrates Infoblox Dossier ingestion from the legacy HTTP Data Collector API to the Microsoft Sentinel Log Ingestion API (DCE/DCR), and updates solution metadata/UI and custom-table schemas accordingly.
Changes:
- Replaced legacy HMAC/WorkspaceKey ingestion with
azure-monitor-ingestion(DCE/DCR) and new env var configuration. - Removed “failed indicators” ingestion/retry components and updated connector UI/docs to reflect the new deployment model.
- Updated sample data + KQL validation schemas to match the new custom table column names/types.
Reviewed changes
Copilot reviewed 50 out of 60 changed files in this pull request and generated 5 comments.
Show a summary per file
| File | Description |
|---|---|
| Solutions/Infoblox/ReleaseNotes.md | Bumps release notes to 3.1.1 with ingestion migration note. |
| Solutions/Infoblox/Package/createUiDefinition.json | Updates workbook description text in the UI definition. |
| Solutions/Infoblox/Data/Solution_Infoblox.json | Increments solution version to 3.1.1. |
| Solutions/Infoblox/Data Connectors/InfobloxCloudDataConnector/requirements.txt | Pins dependencies and adds azure-monitor-ingestion. |
| Solutions/Infoblox/Data Connectors/InfobloxCloudDataConnector/SharedCode/utils.py | Removes legacy failed-indicator table ingestion path. |
| Solutions/Infoblox/Data Connectors/InfobloxCloudDataConnector/SharedCode/table_checkpoint_manager.py | Adds/updates docstrings around checkpoint storage classes. |
| Solutions/Infoblox/Data Connectors/InfobloxCloudDataConnector/SharedCode/sentinel.py | Implements Log Ingestion API client + ingestion helper and removes legacy HMAC logic. |
| Solutions/Infoblox/Data Connectors/InfobloxCloudDataConnector/SharedCode/consts.py | Adds DCE/DCR env vars + stream map, removes WorkspaceKey/failed-indicator constants. |
| Solutions/Infoblox/Data Connectors/InfobloxCloudDataConnector/RetryFailedIndicators/retry_failed_indicators.py | Deletes retry logic for failed indicators. |
| Solutions/Infoblox/Data Connectors/InfobloxCloudDataConnector/RetryFailedIndicators/readme.md | Removes RetryFailedIndicators function documentation. |
| Solutions/Infoblox/Data Connectors/InfobloxCloudDataConnector/RetryFailedIndicators/function.json | Removes RetryFailedIndicators timer trigger bindings. |
| Solutions/Infoblox/Data Connectors/InfobloxCloudDataConnector/RetryFailedIndicators/init.py | Removes RetryFailedIndicators entrypoint. |
| Solutions/Infoblox/Data Connectors/InfobloxCloudDataConnector/Infoblox_API_FunctionApp.json | Updates connector documentation and removes failed-indicator table references. |
| Solutions/Infoblox/Data Connectors/InfobloxCloudDataConnector/InfobloxHistoricalToAzureStorage/infoblox_to_azure_storage.py | Stops ingesting failed ranges into LA and switches to warning logs. |
| Solutions/Infoblox/Data Connectors/InfobloxCloudDataConnector/InfobloxDossierRequiredSource/list_of_sources.py | Updates KQL field names to match new schema; removes WorkspaceKey requirement. |
| Solutions/Infoblox/Data Connectors/InfobloxCloudDataConnector/InfobloxDossierJobResult/get_dossier_result.py | Switches Dossier ingestion to ingest_logs and updates error propagation. |
| Solutions/Infoblox/Data Connectors/InfobloxCloudDataConnector/InfobloxDossierHttpStarter/function.json | Changes HTTP trigger auth level. |
| Solutions/Infoblox/Data Connectors/InfobloxCloudDataConnector/InfobloxCurrentToAzureStorage/infoblox_to_azure_storage.py | Stops ingesting failed ranges into LA and switches to warning logs. |
| Solutions/Infoblox/Data Connectors/InfobloxCloudDataConnector/AzureStorageToIndicators/create_indicator.py | Removes WorkspaceKey requirement from indicator creation. |
| Sample Data/Custom/Infoblox/dossier_whois_CL.csv | Updates sample data to new column schema. |
| Sample Data/Custom/Infoblox/dossier_whitelist_CL.csv | Updates sample data to new column schema. |
| Sample Data/Custom/Infoblox/dossier_tld_risk_CL.csv | Updates sample data to new column schema. |
| Sample Data/Custom/Infoblox/dossier_threat_actor_CL.csv | Updates sample data to new column schema. |
| Sample Data/Custom/Infoblox/dossier_rpz_feeds_records_CL.csv | Updates sample data to new column schema. |
| Sample Data/Custom/Infoblox/dossier_rpz_feeds_CL.csv | Updates sample data to new column schema. |
| Sample Data/Custom/Infoblox/dossier_ptr_CL.csv | Updates sample data to new column schema. |
| Sample Data/Custom/Infoblox/dossier_nameserver_matches_CL.csv | Updates sample data to new column schema. |
| Sample Data/Custom/Infoblox/dossier_nameserver_CL.csv | Updates sample data to new column schema. |
| Sample Data/Custom/Infoblox/dossier_malware_analysis_v3_CL.csv | Updates sample data to new column schema. |
| Sample Data/Custom/Infoblox/dossier_inforank_CL.csv | Updates sample data to new column schema. |
| Sample Data/Custom/Infoblox/dossier_infoblox_web_cat_CL.csv | Updates sample data to new column schema. |
| Sample Data/Custom/Infoblox/dossier_geo_CL.csv | Updates sample data to new column schema. |
| Sample Data/Custom/Infoblox/dossier_dns_CL.csv | Updates sample data to new column schema. |
| Sample Data/Custom/Infoblox/dossier_atp_threat_CL.csv | Updates sample data to new column schema. |
| .script/tests/KqlvalidationsTests/CustomTables/dossier_whois_CL.json | Updates schema definitions for KQL validations. |
| .script/tests/KqlvalidationsTests/CustomTables/dossier_whitelist_CL.json | Updates schema definitions for KQL validations. |
| .script/tests/KqlvalidationsTests/CustomTables/dossier_tld_risk_CL.json | Updates schema definitions for KQL validations. |
| .script/tests/KqlvalidationsTests/CustomTables/dossier_threat_actor_CL.json | Updates schema definitions for KQL validations. |
| .script/tests/KqlvalidationsTests/CustomTables/dossier_rpz_feeds_records_CL.json | Updates schema definitions for KQL validations. |
| .script/tests/KqlvalidationsTests/CustomTables/dossier_rpz_feeds_CL.json | Updates schema definitions for KQL validations. |
| .script/tests/KqlvalidationsTests/CustomTables/dossier_ptr_CL.json | Updates schema definitions for KQL validations. |
| .script/tests/KqlvalidationsTests/CustomTables/dossier_nameserver_matches_CL.json | Updates schema definitions for KQL validations. |
| .script/tests/KqlvalidationsTests/CustomTables/dossier_nameserver_CL.json | Updates schema definitions for KQL validations. |
| .script/tests/KqlvalidationsTests/CustomTables/dossier_malware_analysis_v3_CL.json | Updates schema definitions for KQL validations. |
| .script/tests/KqlvalidationsTests/CustomTables/dossier_inforank_CL.json | Updates schema definitions for KQL validations. |
| .script/tests/KqlvalidationsTests/CustomTables/dossier_infoblox_web_cat_CL.json | Updates schema definitions for KQL validations. |
| .script/tests/KqlvalidationsTests/CustomTables/dossier_geo_CL.json | Updates schema definitions for KQL validations. |
| .script/tests/KqlvalidationsTests/CustomTables/dossier_dns_CL.json | Updates schema definitions for KQL validations. |
| .script/tests/KqlvalidationsTests/CustomTables/dossier_atp_threat_CL.json | Updates schema definitions for KQL validations. |
| .script/tests/KqlvalidationsTests/CustomTables/dossier_atp_CL.json | Updates schema definitions for KQL validations. |
💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.
devendra-chavda
marked this pull request as ready for review
August 19, 2026 12:19
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Required items, please complete
Change(s):
Reason for Change(s):
Version Updated:
Testing Completed:
Checked that the validations are passing and have addressed any issues that are present: