spark-authoring-cli Skill
Develop Microsoft Fabric Spark/data engineering workflows and write code in Fabric Notebook cells with intelligent routing to specialized resources. Provides workspace/lakehouse management, notebook code authoring (PySpark, Scala, SparkR, SQL), and Materialized Lake View (MLV) authoring (Spark SQL MLVs support incremen Published by microsoft in skills-for-fabric.
What is spark-authoring-cli Skill?
Develop Microsoft Fabric Spark/data engineering workflows and write code in Fabric Notebook cells with intelligent routing to specialized resources. Provides workspace/lakehouse management, notebook code authoring (PySpark, Scala, SparkR, SQL), and Materialized Lake View (MLV) authoring (Spark SQL MLVs support incremen Published by microsoft in skills-for-fabric. This profile combines repository metadata with install, compatibility, and usage signals so developers can quickly decide whether it fits their agent workflow before opening the source repository.
Automated repository signals based on public metadata such as recency, license, installation evidence, and adoption. These are not a security audit or endorsement.
Key capabilities
- Includes SKILL.md support
- Reusable instructions support
- Database workflows
- Data analysis
- Writing
- Database workflows use cases
- Data analysis use cases
Technical details
- Install or run with Copy skill directory
When to use spark-authoring-cli Skill
- Use it for database workflows.
- Use it for data analysis.
- Use it for writing.
Built with
Editorial notes
Source
- Creator: microsoft
- Repository: microsoft/skills-for-fabric
- Skill file: plugins/fabric-authoring/skills/spark-authoring-cli/SKILL.md
What it does
Develop Microsoft Fabric Spark/data engineering workflows and write code in Fabric Notebook cells with intelligent routing to specialized resources. Provides workspace/lakehouse management, notebook code authoring (PySpark, Scala, SparkR, SQL), and Materialized Lake View (MLV) authoring (Spark SQL MLVs support incremen
Skill instructions
Update Check — ONCE PER SESSION (mandatory) The first time this skill is used in a session, run the check-updates skill before proceeding. - GitHub Copilot CLI / VS Code: invoke the check-updates skill. - Claude Code / Cowork / Cursor / Windsurf / Codex: compare local vs remote package.json version. - Skip if the check was already performed earlier in this session. CRITICAL NOTES 1. To find the workspace details (including its ID) from workspace name: list all workspaces and, then, use JMESPath filtering 2. To find the item details (including its ID) from workspace ID, item type, and item name: list all items of that type in that workspace and, then, use JMESPath filtering Spark Authoring — CLI Skill This skill covers two complementary areas: (1) managing Fabric Spark artifacts via REST APIs (workspaces, lakehouses, notebooks, jobs, pipelines) and (2) writing code inside Fabric Notebook cells (PySpark, Scala, SparkR, SQL with correct lakehouse access, notebookutils, and Spark configura
Explore related resources
Frequently asked questions
What is spark-authoring-cli?
spark-authoring-cli is a open-source AI agent skill with Copy skill directory. Develop Microsoft Fabric Spark/data engineering workflows and write code in Fabric Notebook cells with intelligent routing to specialized resources.
Who is spark-authoring-cli best for?
spark-authoring-cli is best for reusing agent instructions, scripts, and references, database workflows, data analysis workflows, writing workflows.
How do I install spark-authoring-cli?
Install or run spark-authoring-cli using Copy skill directory. Check spark-authoring-cli for the latest setup command.
Is spark-authoring-cli actively maintained?
spark-authoring-cli may need a closer maintenance check before production use.
Auto-fetched from GitHub.
