By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
Health Works CollectiveHealth Works CollectiveHealth Works Collective
  • Health
    • Mental Health
    Health
    Healthcare organizations are operating on slimmer profit margins than ever. One report in August showed that they are even lower than the beginning of the…
    Show More
    Top News
    healthcare cybersecurity
    4 Helpful Tips on How to Protect Your Medical Practice Against Cyber Attacks
    October 24, 2021
    Health Check Diagnosis Medical Condition Analysis Concept
    6 Health Woes With Online Remedies
    January 19, 2022
    Eight Things Men Should Know About the Male Menopause
    Eight Things Men Should Know About the Male Menopause
    April 24, 2022
    Latest News
    Beyond Nutrition: Everyday Foods That Support Whole-Body Health
    June 15, 2025
    The Wide-Ranging Benefits of Magnesium Supplements
    June 11, 2025
    The Best Home Remedies for Migraines
    June 5, 2025
    The Hidden Impact Of Stress On Your Body’s Alignment And Balance
    May 22, 2025
  • Policy and Law
    • Global Healthcare
    • Medical Ethics
    Policy and Law
    Get the latest updates about Insurance policies and Laws in the Healthcare industry for different geographical locations.
    Show More
    Top News
    healthy nursing school habits
    Healthy Habits for Nursing Student Nursing School Students
    May 24, 2024
    High Deductables
    High-Deductible Insurance and Rising Bad Debt
    July 24, 2015
    How People Are Taking Advantage of Health Deals in the Recent Recession
    February 5, 2021
    Latest News
    Top HIPAA-Compliant Messaging Apps for Healthcare Teams
    June 25, 2025
    When Healthcare Ends, the Legal Process Begins: What Families Should Know About Probate and Medical Estates
    June 20, 2025
    Preventing Contamination In Healthcare Facilities Starts With Hygiene
    June 15, 2025
    Strengthening Healthcare Systems Through Clinical and Administrative Career Development
    June 13, 2025
  • Medical Innovations
  • News
  • Wellness
  • Tech
Search
© 2023 HealthWorks Collective. All Rights Reserved.
Reading: Big Data in Healthcare – Hype or Reality?
Share
Notification Show More
Font ResizerAa
Health Works CollectiveHealth Works Collective
Font ResizerAa
Search
Follow US
  • About
  • Contact
  • Privacy
© 2023 HealthWorks Collective. All Rights Reserved.
Health Works Collective > eHealth > Big Data in Healthcare – Hype or Reality?
eHealth

Big Data in Healthcare – Hype or Reality?

ShahidShah
Last updated: February 26, 2013 9:28 am
ShahidShah
Share
11 Min Read
SHARE

 

 

Many readers write to me regularly to ask what I think about “Big Data” in healthcare. I tell them that Big Data in our field is generally more hype than reality right now but that there’s a lot of promise and opportunity. To help elaborate on why this might be the case I’ve asked my friend Naeem Hashmi, Chief Research Officer at Information Frameworks, to give us his thoughts. Naeem has written a number of books on the subject of informatics and analytics and been on the front lines of engineering large scale healthcare systems to generate data for clinical analytical purposes. Here’s what Naeem had to say about Big Data in Healthcare:

The Big Data bubble in the Healthcare is just filled with the Hot Air – at least for now. Every one is talking about it but when you dig a bit deep with a pointed question, very quickly you discover that it has nothing much to do with the Big Data. We need to understand the spectrum of healthcare segments and look at each segment on feasibility of Big Data components.

More Read

Disruptive Innovation to Improve Mental Health Care
Why Transparency Matters More Than Ever
The Revolutionary Advent Of Precision Medicine In Cancer Treatment
Threatened by Domestic Violence? There’s an App for That
Healthcare Providers Stifle Online Free Speech

I identify the following six distinct healthcare segments as:

  1. Life Sciences
  2. Pharma
  3. Med Device Manufacturers
  4. Care Provider
  5. Payers
  6. Public Health

I did not include Patients in the list as they are mostly content generators, consumers and have much to benefit from but they are on the mercy of other segments. Life Sciences and Pharma segments are already exploiting Big Data elements for OMICs in discovering new drugs and therapies and will discuss details in the later sections.

In this article, I will focus on realities of the Big Data in the Care Providers segments only.

To frame the discussion, let me describe what I mean by Big Data. The Big data consists of the following elements:

  • Content Attributes: 4 Vs (Volume, Variety, Velocity, Veracity) – widely known.
  • Technology Stack: Hadoop-like stacks and Analytics Appliances
  • Computing Model: Extremely Reliable Parallelism
  • Query Model: Hadoop/Map-Reduce use search method (not complex query). So if the intent is to do searches against large unstructured content, the pure Hadoop/map-reduce functions are good fit. Not SQL.
  • Connecting the Dots: Understanding the associative meanings of the interesting patterns hidden underneath massive content-stores.

Care Providers:

The Healthcare Provider segment is extremely fragmented. With ongoing Healthcare reforms, there is some hope that use of EHRs may result in some meaningful use of clinical content. Most of the CIOs are too busy in addressing ICD-10 and CMS Meaningful Use 2 mandates and very few have the time or energy to invest in true Big Data platforms. Data management still remains on the Legacy platforms. So how /where does Big Data fit in the Care Providers segment and challenges?

 

Data Jail

EHR vendors have a lock on patient clinical content in their own proprietary ‘Data Jails’. In my many years as a practitioner I have found it quite difficult to access clinical content and analyze it within these proprietary systems so the Volume and Velocity needed for Big Data is not easy to obtain.

I am using the term ‘Data Jail’ because it takes me back to the early 90′s, when ‘data jail’ term was widely used for the ERP vendors. Then, IT folks had hard time to pull data out of ERPs for reporting and analytics. Today, ERP vendors are quite open and allow accesses to the data. EHR vendors need to learn lessons from ERPs for openness, interoperability and scalability. Opening access to their repositories is good for their customers and for Big Data.

Complexity, Low Volumes and Static Data

 

Most clinical data volumes are quite low and static because you cannot change any historical data in a clinical record. Even though you may append a new record, the rate of change is fairly low unless you’re talking about genetic or proteomic data (which is rare in most settings). Moreover, Clinical content is quite complex. Here content context and semantics are more important than the volume and velocity so you can live with standard relational databases or analytics appliances without the Big Data tools like Hadoop.

 

Real-Time Patient Monitoring

Real-time patient monitoring applications such as bedside heart monitors, OR monitors for anesthesia, dialysis patient monitors, etc. are being piloted in care facilities that demand use of Big Data platform to quickly consume real-time events and signal possible life threatening adverse events before occurring. Increasing use of mobile personal health monitoring devices that stream data back to the care providers also require Big Data elements to capture and predict possible health issues and alarm the care takers and patient for actions. Good candidate for Big Data driven applications.

ACO Level Analytics

ACO level data volumes will be quite high and Big Data will play a key role to develop analytics. The challenge will be how to pull detailed clinical EHRs for the ACO and then to harmonize content in the ACO hub to ensure content quality. Lack of data exchange standards in practical use remains a problem. Even when vendors conform to patient data exchange standard, such as CCD, the actual implementation varies significantly and makes harmonization difficult. For example, Continuity of Care Document (CCD) implementation of two vendors could result in different patient clinical content. That’s because one vendor could provide latitudinal CCD while the other provided encounter specific CCD. Both conform to the CCD specs but payload was different. Here, for the ACO Big Data repository, you need to build a high performance harmonization engine to ensure content consistency before you embark on Analytics.

Valuing Big Data

After going through pain of Big Data implementations, the end goal should remain how to bring valuable insight back in the clinical processes – embedded within the clinical workflows. Most people think that just displaying charts and graphs on a stand-alone dashboard will do the job but of course that’s not the case. Physicians and clinicians do not have time to hop through many screens to care their patients. We need to embed such findings within the clinical work-flows so they have the right alert at the right time for the right patient. You may be stuck with an EHR’s limitations on how open they are so you may not be able to embed non-EHR event with their clinical workflows or work-lists.

Emerging Big Data Opportunity – Comparative Effectiveness Research

As social animals humans they socialize and chat about their daily life stories including dealing with their health issues, families, care givers, behaviors and medications. Such social communication is a gold mine to Pharma and Clinical Outcome researchers to understand effectiveness of a specific therapy. This new field is called the Comparative Effectiveness Research (CER) and Patient Centered Outcomes Research (PCOR). Through the use of Big Data analytics, CER will significantly improve patient care through development of personalized therapies.

Emerging Big Data Clinical Analytics providers

Last year, I served as a judge for the Massachusetts First Health Datapalooza competition. Several Big Data driven clinical applications were part of this competition. I had good discussions with a few vendors. Though their solutions are unique and valuable, none have thought well on how their solution will fit in the clinical setting, client EHR workflows or leverage client’s clinical platform. Just about all Big Data analytics providers are start-ups coming up with innovative care solutions.

When I see in the Big Data market place, it reminds me of ‘dot com’ era of the early 90′s. Lot of small innovative groups developing fascinating tools just like todays in the Healthcare world and unfortunately, a few will survive. My suggestion to such innovators is to keep in mind to develop their Big Data solution are interoperable with the EHRs or ACO business/clinical applications.

Closing thoughts

Big Data in the Clinical practice is just in its evolutionary stages. Most CIOs may be thinking about Big Data but to best of my knowledge I have not seen a pure Big Data implementation in any hospital or clinical practice. Only a handful of large global network of commercial Clinics have implemented such Big Data platforms in production.

Building a Big Data platform and having a team of skilled data scientists in a Hospital or Practice setting is not easy. It is Expensive as well. You will notice that today, only University Hospitals are starting to explore Big Data in the healthcare setting because of funded academic research programs and available pool of graduate students ready to investigate unexplored content. Same is true for the small start-ups companies to develop key healthcare analytics using the social data for public health and patient engagement applications. Today we are just taking baby steps — and we have a long road ahead of us to exploit the true value of Big Data in clinical settings.

Any thoughts or comments?

TAGGED:big data
Share This Article
Facebook Copy Link Print
Share

Stay Connected

1.5kFollowersLike
4.5kFollowersFollow
2.8kFollowersPin
136kSubscribersSubscribe

Latest News

women dental care
What Is a Smile Makeover and How Much Does It Cost?
Dental health
June 30, 2025
HIPAA-Compliant Messaging Apps
Top HIPAA-Compliant Messaging Apps for Healthcare Teams
Global Healthcare Policy & Law Technology
June 25, 2025
recovering from injury
Rebuilding After Injury: Path to Physical and Emotional Recovery
News
June 22, 2025
scientist using microscope
When Healthcare Ends, the Legal Process Begins: What Families Should Know About Probate and Medical Estates
Global Healthcare
June 18, 2025

You Might also Like

engagement
BusinesseHealthSocial Media

7 More Simple Secrets to Engagement, Action and Sharing

March 21, 2014
eHealthTechnology

IoT In Action: Reality, Promises, And Challenges In Healthcare

March 6, 2019
iStock_000018939372XSmall
Medical Records

6 Reasons Why Adopting an EHR Will Increase Practice Efficiency

March 23, 2012

Blue Button Download of Personal Health Data to be Expanded to Federal Employees and Their Families

January 20, 2012
Subscribe
Subscribe to our newsletter to get our newest articles instantly!
Follow US
© 2008-2025 HealthWorks Collective. All Rights Reserved.
  • About
  • Contact
  • Privacy
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?