Normalize notebook cell source before wrapping jobs - #2143
Conversation
|
If integration tests don't run automatically, an authorized user can run them manually by following the instructions below: Trigger: Inputs:
Checks will be approved automatically on success. |
|
Thanks for the fix, @Hashim1999164 — this is a real bug and the change looks good (normalizing Before we can merge, external contributions to this repo need a signed Contributor License Agreement (CLA). It's a one-time agreement confirming you have the right to submit this contribution and granting Databricks permission to distribute it under the project's license — it's about licensing, not your code, and once signed it also covers any future contributions from you. Two quick things so we can get it to you:
Once you confirm, I'll have our legal team send over the CLA. After it's signed and returned, we'll get this merged. Thanks again! |
|
Yes, I am ready to sign the CLA. I am contributing as an individual, not on behalf of a company. Name: Hashim Khan Please send the CLA to that email. I will sign it when it arrives. |
Changes
Run as Databricks Job crashed when an ipynb cell source was a JSON string. Nbformat allows a string or a list. The wrapper now normalizes source to lines before calling flatMap.
Fixes #2142
Tests
Added a unit test with a string cell source next to the existing list source wrap test.