Sync Enables Microsoft Fabric Data Replication With New OneLake Connector

With an eye toward modern trends like diverse data sources, standardized data formats, governance and compliance, and data democratization, Microsoft is investing heavily in its all-in-one data and analytics platform, Microsoft Fabric.

At the heart of Fabric is OneLake, which Microsoft positions as the OneDrive for data. OneLake is a data lake built on Azure Data Lake Storage. It’s designed to make data more reliable and accessible, with a single copy of data shared and updated over time.

Included in the Q4 product release for CData Sync, users can now replicate data into and out of OneLake. Supported file formats include Parquet, Avro, and CSV.

Fabric offers a wide array of options to surface data in OneLake, including data replication and virtualization. Because it uses open-source Delta Lake files, data stored in Snowflake, Databricks, Amazon S3, and Google Cloud Storage can be virtualized into OneLake as well.

OneLake has many integrations natively available, but only a few of those are operational business applications like CRMs. Sync’s connector makes it easy to replicate data from sources, including SAP ERP, NetSuite, and Workday, into OneLake to use in enriched Power BI dashboards.

Sync replication also simplifies the process of ingesting on-premises data into OneLake, without the complications of a separate on-premises gateway.

More from the Q4 release below, with a full blog post on Dynamics 365 as a destination for reverse ETL.

Introducing enhanced CDC in real time

Experience a significant leap in data synchronization with our enhanced change data capture (CDC) Engine for Oracle and PostgreSQL. This engine operates as a continuously running agent, capturing changes from your database every second. By obtaining updates in real-time, it ensures your data is consistently up to date across systems. The primary benefits of our enhanced CDC engine include:

• Improved performance: Real-time data capture reduces latency, providing faster synchronization and more efficient data workflows.
• Low impact on system memory: Designed with optimization in mind, the engine minimizes resource consumption, allowing your systems to run smoothly without heavy memory usage.

Improved Snowflake performance

We've made substantial performance upgrades to our Snowflake integration. Enjoy faster data processing speeds, allowing you to handle larger datasets and more complex analytics with ease. This enhancement is designed to optimize your data operations, giving you quicker insights and better performance.

Custom roles for enhanced security

Also newly released, custom roles is a feature that gives you granular control over user access and permissions, including the ability to restrict the usage of customer-created objects. This allows you to tailor roles to fit your organization's security policies, ensuring that sensitive data and operations are accessible only to authorized personnel.

See full details about everything in the Q4 Sync updates in the release notes.