Data Management Archives - Fresh Gravity

A Natural and Organic Food Company

Fresh Gravity — Fri, 20 Sep 2024 12:31:13 +0000

Fresh Gravity rearchitected and optimized an existing AWS-based data and analytics platform using Databricks. The new platform enhanced data discovery through a 30% improvement in data processing efficiency and a reduction in data onboarding life cycle by 25%.

Problem

The client’s data and analytics platform (an integrated data lake), heavily reliant on AWS-managed services like Redshift, Lambda, and others, faced significant challenges in management, operation, and scalability. This architecture struggled to meet the demands of modern data platforms, limiting the ability to address future business needs. The client sought a streamlined solution architecture to reduce complexity, enable advanced analytics, and minimize operational friction.

Solution

Databricks was used to streamline the overall platform architecture, reduce operational overhead, and empower higher velocity and data throughput. Fresh Gravity’s Auto Data Mapping and Data Modeling tool, Penguin played a pivotal role in building a canonical model for the integrated data lake thus enhancing data integrity that helped in reducing data-related issues

Impact

The redesigned architecture achieved substantial optimization of the client’s data and analytics platform including more efficient and accelerated data discovery. The new platform improved data processing efficiency by 30% which allowed the platform to manage and process 2x the volume of data. In addition, the configuration-driven data processing framework accelerated time-to-delivery of new data analytics initiatives by 25%.

The post A Natural and Organic Food Company appeared first on Fresh Gravity.

US-based Leading Information Services Provider

Fresh Gravity — Mon, 03 Jun 2024 08:38:24 +0000

Fresh Gravity implemented Penguin (Metadata Classifier), a proprietary AI-driven auto data mapping solution, to simplify and accelerate source-to-target-mapping across 3000+ US counties resulting in a reduction data mapping process by 80%.

Problem

The client analyses information assets and data to provide customers with analytics and customized data services. The client also develops proprietary research and tracks current and historical trends in several categories, including consumer credit, capital markets, real estate, fraud, regulatory compliance, natural hazards, and disaster projections. To achieve such a high standard of data analytics, the client processes data coming from 3000+ US counties. On
average, 40% of these processes require manual intervention due to input field mapping issues caused by differences in source files between consecutive versions or data feeds. These range from minor filenames or profiling layout variations to those that require wholesale remapping due to entirely new datasets/schemas. The time it can take for a capture analyst to fix or remap files can span over days or even several weeks, depending on factors such as analyst skill and/or mapping complexity.

Solution

Fresh Gravity was engaged to implement a proprietary solution – Penguin (Metadata Classifier), an innovative, best-in-class Auto Metadata Mapper to simplify and accelerate source-to-target data mapping with an augmented approach. Penguin utilizes metadata, data, and our proven data classification algorithms, along with large language models to simplify data classification and mapping. By learning semantic information from diverse data models and sources, the solution also generates corresponding ontology and canonical models automatically.

Impact

The implementation resulted in annual savings of 300K USD by reducing the data mapping process by over 80% as well as accelerated the data provisioning for business. In addition, it helped repurposing 10k+ people hours to other business needs.

The post US-based Leading Information Services Provider appeared first on Fresh Gravity.

US-based Software Company

Fresh Gravity — Mon, 03 Jun 2024 08:37:27 +0000

Fresh Gravity built a harmonized Master Data Management (MDM) solution using Reltio, with emphasis on accurate territory operations coupled with increasing the accuracy of addresses. D&B enrichment and relevance-based de-duplication reduced data stewardship effort by 15% in the new MDM platform.

Problem

The client was facing problems in assigning territories to the correct operations team because of data quality issues within Salesforce. This further created discrepancies between revenue reporting and sales rep incentive management between the CRM and financial systems.

Solution

Fresh Gravity created a B2B customer MDM solution by sourcing the data from CRM and financial systems by de-duplicating, cleansing, and standardizing the data across different geographies. 3.2 million addresses were verified and synchronized with the CRM and financial systems with near real-time data exchange frameworks.

Impact

Close to real-time data exchange improved the onboarding process for new customers in turn enabling quicker transactions for the client. Junk and undeliverable addresses were reduced by over 25% due to efficient global standardization resulting in accurate territory alignment. Multiple matching algorithms combined with Dun & Bradstreet (D&B) data enrichments increased the value of data across the enterprise resulting in multiple new subscriptions to the data internally.

The post US-based Software Company appeared first on Fresh Gravity.