Skip to content
Search to learn about InterSystems products and solutions, career opportunities, and more.

Applying Data Fabrics Across Industries

Eleven common questions and answers

Today more than ever before, organizations are striving to gain a competitive edge, deliver more value to customers, reduce risk, and respond more quickly to the needs of the business. To achieve these goals, organizations need easy access to a single view of accurate, consistent, and trusted data – and all in real time. However, growing volumes and complexities of data make this difficult to achieve in practice. As data grows, so does the prevalence of data silos, making integrating and leveraging data from internal and external data sources a challenge.

Recently, data fabrics have emerged as a much-needed architectural approach to providing accurate visibility across the entire business, without the problems associated with data warehouses, data lakes, and other approaches to data integration and data management. Data fabrics can transform and harmonize data from multiple sources on demand to create a single, trusted, accurate, and current source of truth to service all consumers of the data. Smart data fabrics take this approach a step further by incorporating a wide range of analytics capabilities, including data exploration, business intelligence, natural language processing, machine learning, and even generative AI, enabling organizations to gain new insights and power intelligent prescriptive services and applications.

We often get questions about how data fabrics can be applied to address specific industry challenges. Below are answers to eleven common questions.

How data fabrics can be applied to address specific industry challenges

Q1. Are data governance and data fabric the same thing?
Data governance and data fabric are related, but they are very different. Data governance is an overarching set of initiatives that strive to define and enforce the quality, usage, and security of data within an organization. It includes policies, standards, processes, rules, roles and responsibilities, privileges, and more. In contrast, a data fabric is an architectural pattern that strives to create consistency among all data and metadata in an organization to make data easy to find, access, and use. A data fabric can be a critical component of a successful data governance program.
Q2. What solutions does a data fabric provide for disparate data-related issues in the financial services industry?
Although financial services organizations come to us with a vast array of problems stemming from disparate data related issues, the primary solution for all of these organizations is a modern data architecture that ensures that all data consumers have access to a consistent set of accurate, current, trusted, and secure information.

In general, a data fabric provides a modern approach to create one single source of truth from all the disconnected, disparate, and dissimilar data sources inside and outside the organization that feeds all consumers of the data, whether that’s business users, applications, data scientists, clients, regulators, and so on. It also provides a consistent and overarching metadata layer, and a semantic layer that maintains relationships among the various data and metadata. A data fabric can eliminate the errors and redundancies introduced by maintaining multiple individual data repositories that serve different consumers of the data. It should allow data to be optionally persisted or virtualized (not persisted), handle real time streaming data as well as batch data at scale, be able to natively manage a wide variety of data types including unstructured data (multi-model), and have embedded analytics for real time advanced analytic processing without moving the data to a different environment for analytics (smart data fabric).
Q3. Jey Amalraj, CTO of Harris Associates, a financial services asset management firm with $100 billion in assets under management, presented a keynote at the InterSystems Global Summit, focusing on “Leveraging a Smart Data Fabric for Financial Services”. What was his main message?
Harris Associates is one of our customers, and Jey has been leading data management initiatives in the financial services industry for decades. Their main requirement is exactly what was mentioned earlier: to create a single source of truth spanning all data sources that serves all of their consumers of the data. He has worked with most of the different data management technologies over the course of his career, including point-to-point integrations, integration platforms, data marts, data lakes, and more.

His quote regarding data fabrics is, “I’ve been working with data for 25 years. We’ve been through a few solutions. We’ve finally found something which works.”
Q4. How do you implement a data fabric for financial services?
A key attribute of data fabrics is that they’re non-disruptive to an organization’s existing technical infrastructure. They connect the existing technologies, including applications, data streams, databases, data warehouses, data lakes, etc. without requiring any “rip-and-replace.” A good implementation approach is to define well-scoped projects that can provide measurable business value in the short term (a few weeks or months) that expose and connect data that is ripe for re-use for future projects, and work in an incremental manner, avoiding multi-year big bang implementations. For those of us that have been around for a while, this is exactly how we approached service-oriented architecture initiatives in the late nineties and early 2000s.

There are many ways to implement a data fabric. One way is to implement and integrate many different data management point solutions, for example for relational and non-relational database management, integration, caching layer, data catalog, workflow, business intelligence, machine learning, metadata and semantic data management, etc. We’ve seen that organizations that try this approach usually end up with a complex and inefficient architecture that is slow to deploy, difficult to maintain, lacks performance, and is inefficient in its use of infrastructure resources. Instead, a recommended approach is to look for data platform technology that provides many of the required functionality in one single product or platform. One of our customers, a $5B fintech software provider, has been able to replace eight different technologies with our one single product, gaining nine times better performance running on only 30% of the infrastructure, and with a far simpler architecture.

Q5. Let’s talk about supply chains. Supply chains generate vast amounts of data from various sources. Can a data fabric model across the IT ecosystem be used also to solve supply chain challenges?
Absolutely! Supply chains are a perfect domain for data fabrics because they are large, disparate, and complex, spanning many different organizations, all with their own dissimilar data and application stacks. Organizations require real-time visibility across the end-to-end supply through distribution continuum to easily understand the status of millions or potentially billions of components and react to unexpected issues and disruptions as they occur.
Q6. What about disruptions to supply chain operations?
Handling disruptions quickly and efficiently is the top issue in supply chain operations. Disruptions are a constant occurrence, and one of the most challenging supply chain related issues that an organization must deal with. An intelligent control tower must not only provide real time end to end visibility, but also it must deliver predictive insights regarding the likelihood of disruptions, calculate the impact on the business, and present a set of data-driven prescriptive options for preventing potential disruptions in advance, or handling them in real time when they occur. For example, geopolitical events, labor shortages, supply failures, weather patterns, and rapidly changing consumer demand can all impact supply and demand. Organizations can accelerate data driven decision-making by leveraging a data fabric with embedded analytics to achieve a higher level of decision support and automation-driven outcomes.
Q7. Is a data fabric strategy a path to a digital supply chain transformation? If yes, what does it mean in practice?
Yes, very much so. Most organizations are moving to an “analytics and decision intelligence” data platform strategy to meet their digital transformation goals in supply chain. To do so, it requires a modern architecture that can harmonize and normalize data from any disparate data source in real-time, simulate business processes and provide AI and ML capabilities to enable dynamic optimized decision making at the line of business level. In practice, there are industry standard digital maturity models that can provide guidance. The progression starts with understanding organizational requirements and critical KPIs, then leveraging a foundational data fabric architecture and developing processes to incrementally progress to the higher levels of digital maturity, which is achieving a predictive, autonomous, and adaptive supply chain.
Q8. Do you have any examples to share with us?
Of course, we have many examples of customers that are leveraging a smart data fabric in supply chain to achieve outstanding results. One of our customers is the largest wholesaler of drugs and cosmetics in Japan. They distribute 50,000 different products from 1,000 different manufacturers to 400 different retailers that operate more than 50,000 stores per year. That’s a total of 3.5 billion products every year! Using this approach, they’re achieving 99.999% On Time In Full (OTIF) delivery accuracy, compared with an industry average of around 65%. That means that for every 100,000 products they deliver, 99,999 are delivered to the customer both on time, and in full. That’s an incredible achievement.
Q9. Let’s now look at data fabric applicability in manufacturing industries. What are the benefits of using data fabric for the manufacturing industries?
Industry 4.0 is all about digitizing the manufacturing environment and enabling OT/IT convergence to streamline the entire process chain and improve efficiencies and responsiveness. And it’s not just creating digital twins for the factory. A data fabric can span supply through manufacturing, assembly, and distribution, including SCP, MRP, MES, ERP, CRM, PLM, inventory management, and more to provide true end to end visibility. And just as with supply chain, a smart data fabric that provides advanced analytics capabilities embedded within the fabric can provide predictive and prescriptive analytics, for example to inform predictive maintenance to keep critical production lines running, to balance supply with predicted fluctuations in demand, and to optimize staffing.
Q10. Do you have any examples of problems a data fabric solves for the healthcare industry?
We also see many practical applications of a data fabric with our healthcare customers. One of our customers, an academic medical center, needed a centralized entry point for internal and external consumers to access information distributed across the organization’s many data silos. The data fabric serves as an API service layer, allowing authorized end-users and other clients to access information in realtime to support their real-time applications that access and process data distributed among their enterprise data warehouse, data lake, EMR, and other silos. To satisfy regulatory requirements, they’re using the data fabric as a FHIR façade for relational data that resides within their enterprise data warehouse. The medical center also benefits from using the smart data fabric as an analytics layer to allow analysts and analytics toolsets to explore and report on data across different sources, incorporating near-real time information alongside data residing in their traditional long-term storage for more up-to-date analytics, uncovering new insights and patterns that would otherwise have been hidden within data silos.
Q11. Anything else you wish to tell us?
Many industry analysts are promoting the data fabric architecture as the preferred approach for many use cases, especially where there is a lot of disparate and dissimilar data to be managed. However, it can be overwhelming to get started. We recommend that the technical teams in an organization work closely with stakeholders in the line of business to identify the use cases that can bring the most value to the organization and implement in sprints that each provide some measurable business value. We also recommend working with a trusted partner that has proven experience with similar organizations and use cases to help with strategy, best practices, and implementation.

Other Resources You Might Like

Oct 04, 2024
Product Fact Sheet
InterSystems Data Fabric Studio is an essential element of a modern data strategy required to enable growth, optimize business reporting, reduce risk, and support compliance for any firm in the financial services industry.
Sep 26, 2024
Discover how vector databases power AI, enhance search, and scale data processing. Learn their benefits and applications for your business with InterSystems.
Sep 18, 2024
Discover how database sharding enhances performance and scalability. Learn its benefits, methods, and best practices for implementing this powerful data distribution technique in your business.
Sep 17, 2024
Explore vector search: the game-changing technology powering AI and machine learning. Learn how it works and transforms data retrieval with InterSystems IRIS.
Sep 16, 2024
Demystify vector embeddings: Learn what they are, how they work, and why they're crucial for AI.
Sep 16, 2024
Explore how generative AI in healthcare is revolutionizing patient care, diagnosis, and drug discovery. Learn about its applications, benefits, and ethical considerations.
Sep 16, 2024
Discover what a relational database is, its key features, and why it's crucial for your business. Learn about its advantages, popular systems, and how it compares to other database
Sep 09, 2024
Spotlight by Bloor
Data fabric is a more flexible data architecture that can work without building yet more data silos and instead synamically access data in situ in operational source systems.
Sep 09, 2024
Bloor Market Update
A look at the current state of the data fabric market by Bloor Research
Sep 07, 2024
Bloor Research
A Bloor Gold Mutable Award 2024By Andy Hayler – Practice Leader, Data as an Asset

Take The Next Step

We’d love to talk. Fill in some details and we’ll be in touch.
*Required Fields
Highlighted fields are required
*Required Fields
Highlighted fields are required

By submitting your business contact information to InterSystems through this form, you acknowledge and agree that InterSystems may process this information, for the purpose of fulfilling your submission, through a system hosted in the United States, but maintained consistent with any applicable data protection laws.



** By selecting yes, you give consent to be contacted for news, updates and other marketing purposes related to existing and future InterSystems products and events. In addition, you consent to your business contact information being entered into our CRM solution that is hosted in the United States, but maintained consistent with applicable data protection laws.