How does this work if you have multiple developers in the workspace? Looks like the Personal Access Token is specific to one person. Does this mean that all commits will be reflected as the person who owns the PAT?
Could you please do more videos on this subject? Github integration with Fabric workspaces, for example making use of github actions for power BI deployments
MS git integration is still buggy and incomplete. MS must really start to understand that being a true enterprise solution means patience. Make sure your stuff works before you announce it.
None yet according to the MS forums. Here's what you do to get this working, if there's enough interest, I'll make a video showing how to do this. First off go to your Dataflow Gen 2, add a new parameter and an output variable- One is a Bool called FromPipelineParam (default to False), the other is Gen2JSONVar which is an Array. Before the very first node on your Gen 2 add an If node that takes the FromPipelineParam and if False diverts to the regular Pipeline activities or if True directly to a new Set Variable expression, in the Set Variable Node set the Gen2JSONVar as the JSON code for the Dataflow and define it as an Output Variable. Now make a Data Pipeline with a Bool var called FromPipelineVar and default it to True as well as an Array Var called Gen2JSON, in the pipeline, call the Dataflow Gen 2 via the Invoke function and pass the FromPipelineVar to the Dataflow Gen 2 as an Input Parameter and Return the Gen2JSONVar to the local Var in the Pipeline then log the results as an Expression in the Pipeline. Now when this Pipeline is executed it will retrieve the Dataflow Gen 2 JSON and store it in the Pipeline. To integrate this with CI/CD, set up your Azure Agent and Parallel Job and have it fire API actions to retrieve the Pipelines and git commit when changes are detected, as executed by an Azure Pipeline. There's a great python SDK called msfabricpysdkcore on pypi where you can get this all set up.
Hi @Guy in a cube, could you please create a video on KeyVault in Fabric. what is possible, what's not? Access to KeyVault from Fabric Resources like Notebook, pipeline, Spark job definition? which authentication is possible, user, service principle, managed/workspace identity?
Keyvault access using workspace identity isn’t there yet. But KV from notebook works well. It access the key vault with the identity of the person who set up the schedule. You can user service principles. But would be so much nicer to use a workspace identity as they are simple to setup.
Q: imagine 2 dev working on their own branch for a speacific feature, dev 1 commits and PR, it got merged, dev 2 will want to checkout and git pull and the commit back how does will work as pbi files are in binary format so you don't have any diff ?
@@ilyas5796 you have to enable the tmdl feature. Then when you edit your actually editing a json file not a pbix anymore. Main gotcha is if you have the model/report open then pull updates underneath PBI desktop and then save it will overwrite your pull. I.e. PBI desktop is not aware the files have changed whilst it’s open. I use it with 10 devs in a workspace and lots of objects.
Is it possible to restore previous versions of a pbip file? When yes how do I do it? Because since now the only thing I saw in different videos is, that it enables mutlitple developers to work on one file concurrently.
Q: My DevOps integration works fine, my GitHub is greyed-out and I can't select it to start the config. (I have a git Repo, I have a fine grain key etc...) Any suggestion? Using GitHub Enterprise.
GitHub finally! Thanks for sharing Adam!
Good stuff Adam! I'd like to see the GitHub Enterprise video!
Same here Adam!
I think it is working the same way.
The only difference is that, for some reason, couldn't connect with fine-grained token.
How does this work if you have multiple developers in the workspace? Looks like the Personal Access Token is specific to one person. Does this mean that all commits will be reflected as the person who owns the PAT?
Thanks for showing the process at this level of detail, I'd like to have a similar demo with GitHub Enterprise.
It would be nice if Power BI pro workspaces can have it
Could you please do more videos on this subject? Github integration with Fabric workspaces, for example making use of github actions for power BI deployments
Thanks Adam
Hi Adam, your Git terminal is really cool, how did you customize it?
I meant to ask the same question
Oh my PoSh
@@wojciechjaniszewski9086 ruclips.net/video/bM0FYTi11Wg/видео.html
MS git integration is still buggy and incomplete. MS must really start to understand that being a true enterprise solution means patience. Make sure your stuff works before you announce it.
Any word when dataflow gen2 will be supported?
None yet according to the MS forums.
Here's what you do to get this working, if there's enough interest, I'll make a video showing how to do this.
First off go to your Dataflow Gen 2, add a new parameter and an output variable- One is a Bool called FromPipelineParam (default to False), the other is Gen2JSONVar which is an Array.
Before the very first node on your Gen 2 add an If node that takes the FromPipelineParam and if False diverts to the regular Pipeline activities or if True directly to a new Set Variable expression, in the Set Variable Node set the Gen2JSONVar as the JSON code for the Dataflow and define it as an Output Variable.
Now make a Data Pipeline with a Bool var called FromPipelineVar and default it to True as well as an Array Var called Gen2JSON, in the pipeline, call the Dataflow Gen 2 via the Invoke function and pass the FromPipelineVar to the Dataflow Gen 2 as an Input Parameter and Return the Gen2JSONVar to the local Var in the Pipeline then log the results as an Expression in the Pipeline.
Now when this Pipeline is executed it will retrieve the Dataflow Gen 2 JSON and store it in the Pipeline.
To integrate this with CI/CD, set up your Azure Agent and Parallel Job and have it fire API actions to retrieve the Pipelines and git commit when changes are detected, as executed by an Azure Pipeline.
There's a great python SDK called msfabricpysdkcore on pypi where you can get this all set up.
What can I use instead of power Shell, maybe Visual Studio?
does fabric workspace respect .gitignore? i dont want pipeline and lakehouse file to get synced, could you please let me know
Hi @Guy in a cube, could you please create a video on KeyVault in Fabric. what is possible, what's not? Access to KeyVault from Fabric Resources like Notebook, pipeline, Spark job definition? which authentication is possible, user, service principle, managed/workspace identity?
Keyvault access using workspace identity isn’t there yet. But KV from notebook works well. It access the key vault with the identity of the person who set up the schedule. You can user service principles. But would be so much nicer to use a workspace identity as they are simple to setup.
Can we use devops that’s on a different tennant yet?
Q: imagine 2 dev working on their own branch for a speacific feature, dev 1 commits and PR, it got merged, dev 2 will want to checkout and git pull and the commit back how does will work as pbi files are in binary format so you don't have any diff ?
@@ilyas5796 you have to enable the tmdl feature. Then when you edit your actually editing a json file not a pbix anymore. Main gotcha is if you have the model/report open then pull updates underneath PBI desktop and then save it will overwrite your pull. I.e. PBI desktop is not aware the files have changed whilst it’s open. I use it with 10 devs in a workspace and lots of objects.
Is it possible to restore previous versions of a pbip file? When yes how do I do it? Because since now the only thing I saw in different videos is, that it enables mutlitple developers to work on one file concurrently.
Q: Do we need a Premium license to integrate with GitHub? Currently have a pro license, wanted to understand if that would allow?
GH integration looks amazing. But in my company GH enterprise, I can only connect via company VPN so I wonder if it might not work with Fabric *:-(
Q: My DevOps integration works fine, my GitHub is greyed-out and I can't select it to start the config. (I have a git Repo, I have a fine grain key etc...) Any suggestion?
Using GitHub Enterprise.
It should be enabled in the admin section I think...
God damn, Microsoft, you made a git integration but you didn't ensure automated sync with git repo, are you kidding me?!
Cool
ok, im old, 0.75 speed enabled :D
Any plans to remove the Enterprise Whitelisting limitation? This is why we won't use it today