Data Lake Governance for Leading Real Estate Tech Company to Make Portal CCPA Compliant

INDUSTRY

Real Estate

REVENUE

$10 - $50 Billion

At a Glance

Traditionally, data has resided in silos across any organization, so it's difficult to have a complete picture for data driven business decision making. Also, the use of obsolete legacy systems leads to ineffective data management and impacts operational efficiency. A shift to advanced data lake governance platforms can lead to superior enterprise data management. Learn how Emtec Digital assisted a leading real estate marketplace company in the US to upgrade their data architecture.

About the Customer

Our client runs a leading real estate marketplace company in the United States. The company portal is a one-stop-shop for home buyers and sellers, where 150 million unique users visit every month to find their homes and home buyers.

Business Need

Users across the country leverage client’s web or app portal to buy, sell, rent, mortgage properties, and connect with property dealers. With a ton of data pouring in from diverse sources, our client standardization and sanitization to gain actionable insights and improve their operations.


In tandem, the California Consumer Privacy Act (CCPA) was introduced to protect user data. To adhere to this CCPA compliance, a stipulated timeline was established. The non-compliance of this timeline would attract financial and legal penalties. The client was obligated to abide by these data privacy regulations and provide a secure user experience. It created challenges such as -

Scattered data among different data stores across their IT ecosystem

Included conventional, NoSQL, Data Lake and data streaming platforms

Difficult to locate Personally Identifiable Information (PII) and Personal Information (PI) across diverse data sources

The need of the hour was an immediate upgrade of the client’s architecture. That's where Emtec Digital stepped in.

Our Solution

The team of experts at Emtec Digital scanned the client’s AWS cloud-based landscape and analyzed various hybrid and cloud-native integrations. Because of disparate data storage locations and humongous volume, the optimal solution was to build a unified data lake governance platform and data compliance service.


We successfully developed a platform that would access each datastore to analyze data and make it CCPA compliant. Also, the platform would enable the client to export and delete users' PI and PII within 30 days of receiving the request. The user can go to a cross-brand portal, authenticate across all client brands, and submit an export or delete request.


This platform will validate the business relationship if any and execute export/delete requests accordingly. It will pass on the user's request to all data agents. Each agent will perform the export/delete request and return the result through the data compliance service to users.

CCPA-ARCHITECTURE-DIAGRAM

Technical and Business Benefits

Emtec Digital contributed to the client’s successful implementation of CCPA compliance across the organization.

A custom solution built around three key areas: data governance, data compliance, and workers.

The client gained quality checks, and smooth integration within the client ecosystem.

The solution became the go-to monitoring platform to observe the system’s behavior, cost optimization and SLA analysis.

Data granularity helps the product teams to enable user friendly product enhancements.

Unique Differentiators

Customers are more inclined to buy products from a company that provides data security, so the company will now have a competitive advantage over others.

CCPA will allow companies to have more reliable data in the long run and improve their marketing strategies.

Technologies that saved the day

Emtec-Digital-AWS-partner
google-cloud-partner

Business Impact

Real-time request processing as per the guidelines

Unified privacy service for company-wide data platforms

Simplified data governance for CCPA compliance

Fulfilling approximately 1000 export/delete requests per month

Quick scan across enterprise-wide data (hundreds of TBs) as needed

Improved data engineering and intelligent insights for product enhancements

Want to modernize legacy applications for superior performance and user experience?

Read on

Knowledge Graph blog Thumbnail Image

Blog

Knowledge Graphs – A Smart Data Solution for Smart Enterprises

THUMBNAIL-MICROSOFT POWER BI

Case Study

How to enhance Data Visualization and Analytics with Power BI

Thumbnail-data-lake-solutions-case-study

Case Study

Enterprise Data Management | Data Lake Case Study

Whitepaper

The Secret Sauce To Become A Data Driven Enterprise

Sign up for insights