hdinsight-migration Skill
Port Azure HDInsight Spark clusters and Hive workloads to Microsoft Fabric. Removes legacy HiveContext and standalone SparkContext constructors, replacing them with the pre-instantiated SparkSession. Converts WASB and ABFS storage paths to OneLake abfss URLs via Shortcuts. Transforms Hive DDL (STORED AS ORC, external t Published by microsoft in skills-for-fabric.
What is hdinsight-migration Skill?
Port Azure HDInsight Spark clusters and Hive workloads to Microsoft Fabric. Removes legacy HiveContext and standalone SparkContext constructors, replacing them with the pre-instantiated SparkSession. Converts WASB and ABFS storage paths to OneLake abfss URLs via Shortcuts. Transforms Hive DDL (STORED AS ORC, external t Published by microsoft in skills-for-fabric. This profile combines repository metadata with install, compatibility, and usage signals so developers can quickly decide whether it fits their agent workflow before opening the source repository.
Automated repository signals based on public metadata such as recency, license, installation evidence, and adoption. These are not a security audit or endorsement.
Key capabilities
- Includes SKILL.md support
- Reusable instructions support
- Developers using skills-for-fabric
Technical details
- Install or run with Copy skill directory
When to use hdinsight-migration Skill
- Use it for developers using skills-for-fabric.
Built with
Editorial notes
Source
- Creator: microsoft
- Repository: microsoft/skills-for-fabric
- Skill file: skills/hdinsight-migration/SKILL.md
What it does
Port Azure HDInsight Spark clusters and Hive workloads to Microsoft Fabric. Removes legacy HiveContext and standalone SparkContext constructors, replacing them with the pre-instantiated SparkSession. Converts WASB and ABFS storage paths to OneLake abfss URLs via Shortcuts. Transforms Hive DDL (STORED AS ORC, external t
Skill instructions
Update Check — ONCE PER SESSION (mandatory) The first time this skill is used in a session, run the check-updates skill before proceeding. - GitHub Copilot CLI / VS Code: invoke the check-updates skill. - Claude Code / Cowork / Cursor / Windsurf / Codex: compare local vs remote package.json version. - Skip if the check was already performed earlier in this session. CRITICAL NOTES 1. To find workspace details (including its ID) from a workspace name: list all workspaces, then use JMESPath filtering 2. To find item details (including its ID) from workspace ID, item type, and item name: list all items of that type in that workspace, then use JMESPath filtering 3. HDInsight has no mssparkutils or dbutils equivalent — notebookutils is net-new capability being introduced 4. HiveContext and SQLContext are legacy Spark 1.x/2.x APIs — Fabric uses Spark 3.x SparkSession exclusively 5. wasb:// paths are deprecated and require a Storage Account key or SAS — replace with OneLake shortcuts HDInsight
Explore related resources
Frequently asked questions
What is hdinsight-migration?
hdinsight-migration is a open-source AI agent skill with Copy skill directory. Port Azure HDInsight Spark clusters and Hive workloads to Microsoft Fabric. Removes legacy HiveContext and standalone SparkContext constructors, replacing them with the pre-instantiated SparkSession.
Who is hdinsight-migration best for?
hdinsight-migration is best for reusing agent instructions, scripts, and references.
How do I install hdinsight-migration?
Install or run hdinsight-migration using Copy skill directory. Check hdinsight-migration for the latest setup command.
Is hdinsight-migration actively maintained?
hdinsight-migration may need a closer maintenance check before production use.
Auto-fetched from GitHub.
