Skip to content

[Infoblox][Data Connector] - Migrate Checkpoint From File Share to Azure Table#14689

Open
jbhaliya-crest wants to merge 2 commits into
Azure:masterfrom
jbhaliya-crest:infoblox-data-connector-update-checkpoint
Open

[Infoblox][Data Connector] - Migrate Checkpoint From File Share to Azure Table#14689
jbhaliya-crest wants to merge 2 commits into
Azure:masterfrom
jbhaliya-crest:infoblox-data-connector-update-checkpoint

Conversation

@jbhaliya-crest

Copy link
Copy Markdown

Change(s):

  • Migrated the checkpoint from file share to azure tables.
  • JSON file parsing bug fix.

Reason for Change(s):

  • Client requested and bug fix

Version Updated:

  • NA

Testing Completed:

  • Yes

@jbhaliya-crest
jbhaliya-crest requested review from a team as code owners July 16, 2026 10:23
@v-atulyadav
v-atulyadav requested a review from Copilot July 16, 2026 10:25
@v-atulyadav v-atulyadav added the Solution Solution specialty review needed label Jul 16, 2026

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Note

Copilot was unable to run its full agentic suite in this review.

Migrates Infoblox data connector checkpointing from Azure File Share to Azure Table Storage and adds resilience fixes for malformed JSON parsing / chunk stitching.

Changes:

  • Introduces an Azure Table-based checkpoint manager and updates multiple functions to read/write checkpoints via tables (with migration from legacy file-share checkpoints).
  • Adds JSON parsing recovery and improves raw JSON chunk joining by stripping leading commas.
  • Updates ARM deployment/config to include a checkpoint table name and adds the azure-data-tables dependency.

Reviewed changes

Copilot reviewed 10 out of 14 changed files in this pull request and generated 8 comments.

Show a summary per file
File Description
Solutions/Infoblox/ReleaseNotes.md Updates release notes entry to mention the checkpoint migration and refreshes the modified date.
Solutions/Infoblox/Data Connectors/InfobloxCloudDataConnector/requirements.txt Adds Azure Tables SDK dependency for the new checkpoint storage backend.
Solutions/Infoblox/Data Connectors/InfobloxCloudDataConnector/azuredeploy_Connector_InfoBloxCloud_AzureFunction.json Adds Checkpoint_Table_Name app setting for the connector functions.
Solutions/Infoblox/Data Connectors/InfobloxCloudDataConnector/SharedCode/utils.py Adds Azure Table checkpoint helpers; adds malformed JSON recovery; caches customer_id in checkpoint table and adds headers.
Solutions/Infoblox/Data Connectors/InfobloxCloudDataConnector/SharedCode/table_checkpoint_manager.py Adds Table Storage wrapper and TableCheckpointManager adapter.
Solutions/Infoblox/Data Connectors/InfobloxCloudDataConnector/SharedCode/consts.py Adds constants and env var for checkpoint table name + customer-id checkpoint key.
Solutions/Infoblox/Data Connectors/InfobloxCloudDataConnector/InfobloxParseRawIndicators/parse_json_files.py Switches parse-progress checkpoints to tables (with migration) and hardens JSON stitching.
Solutions/Infoblox/Data Connectors/InfobloxCloudDataConnector/InfobloxHistoricalToAzureStorage/infoblox_to_azure_storage.py Switches time-based checkpoints + retry counters to tables (with migration).
Solutions/Infoblox/Data Connectors/InfobloxCloudDataConnector/InfobloxCurrentToAzureStorage/infoblox_to_azure_storage.py Switches time-based checkpoints + retry counters to tables (with migration).
Solutions/Infoblox/Data Connectors/InfobloxCloudDataConnector/AzureStorageToIndicators/create_indicator.py Migrates indicator_count checkpoint to tables (with migration) and uses table-based helpers.
Comments suppressed due to low confidence (2)

Solutions/Infoblox/ReleaseNotes.md:1

  • This row’s table formatting is inconsistent with the other entries (it introduces 3 || where prior rows start with ||). This likely breaks the Markdown table rendering; align the row prefix/column count with the other version rows.
| **Version** | **Date Modified (DD-MM-YYYY)** | **Change History**                          |

Solutions/Infoblox/ReleaseNotes.md:1

  • Correct spelling of 'Migrataed' to 'Migrated'.
| **Version** | **Date Modified (DD-MM-YYYY)** | **Change History**                          |

@jbhaliya-crest

Copy link
Copy Markdown
Author

@microsoft-github-policy-service agree company="Crest Data"

@v-maheshbh

Copy link
Copy Markdown
Contributor

Hi @jbhaliya-crest

Please provide the testing screenshots validating the changes included in this PR.

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Solution Solution specialty review needed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants