By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
Health Works CollectiveHealth Works CollectiveHealth Works Collective
  • Health
    • Mental Health
    Health
    Healthcare organizations are operating on slimmer profit margins than ever. One report in August showed that they are even lower than the beginning of the…
    Show More
    Top News
    benefits of using protein powder to build muscles
    Protein Powder for Muscle Mass: Everything You Need to Know
    December 12, 2021
    changes brought on by blockchain in healthcare
    Technology In The Healthcare Industry
    March 28, 2022
    What Does Core Body Temperature Say About Health?
    August 17, 2022
    Latest News
    Grounded Healing: A Natural Ally for Sustainable Healthcare Systems
    May 16, 2025
    Learn how to Renew your Medical Card in West Virginia
    May 16, 2025
    Choosing the Right Supplement Manufacturer for Your Brand
    May 1, 2025
    Engineering Temporary Hospitals for Extreme Weather
    April 24, 2025
  • Policy and Law
    • Global Healthcare
    • Medical Ethics
    Policy and Law
    Get the latest updates about Insurance policies and Laws in the Healthcare industry for different geographical locations.
    Show More
    Top News
    FDA Approves Diabetes Pill
    May 2, 2011
    Patient Gets Drunk on Hand Sanitizer
    June 20, 2011
    Cultivating Health Improvement
    July 20, 2011
    Latest News
    Building Smarter Care Teams: Aligning Roles, Structure, and Clinical Expertise
    May 18, 2025
    The Critical Role of Healthcare in Personal Injury Recovery: A Comprehensive Guide for Victims
    May 14, 2025
    The Backbone of Successful Trials: Clinical Data Management
    April 28, 2025
    Advancing Your Healthcare Career through Education and Specialization
    April 16, 2025
  • Medical Innovations
  • News
  • Wellness
  • Tech
Search
© 2023 HealthWorks Collective. All Rights Reserved.
Reading: Big Data in Healthcare – Hype or Reality?
Share
Notification Show More
Font ResizerAa
Health Works CollectiveHealth Works Collective
Font ResizerAa
Search
Follow US
  • About
  • Contact
  • Privacy
© 2023 HealthWorks Collective. All Rights Reserved.
Health Works Collective > eHealth > Big Data in Healthcare – Hype or Reality?
eHealth

Big Data in Healthcare – Hype or Reality?

ShahidShah
Last updated: February 26, 2013 9:28 am
ShahidShah
Share
11 Min Read
SHARE

 

 

Many readers write to me regularly to ask what I think about “Big Data” in healthcare. I tell them that Big Data in our field is generally more hype than reality right now but that there’s a lot of promise and opportunity. To help elaborate on why this might be the case I’ve asked my friend Naeem Hashmi, Chief Research Officer at Information Frameworks, to give us his thoughts. Naeem has written a number of books on the subject of informatics and analytics and been on the front lines of engineering large scale healthcare systems to generate data for clinical analytical purposes. Here’s what Naeem had to say about Big Data in Healthcare:

The Big Data bubble in the Healthcare is just filled with the Hot Air – at least for now. Every one is talking about it but when you dig a bit deep with a pointed question, very quickly you discover that it has nothing much to do with the Big Data. We need to understand the spectrum of healthcare segments and look at each segment on feasibility of Big Data components.

More Read

VNA storing and sharing information
How a VNA Unifies Clinical Data Throughout an Enterprise
High Quality, Low Cost HealthCare Video Interview Series: John Holland Talks Patient Telemonitoring at AMC Health
Medical Image Archiving in the Cloud? Consider the 4 S’s
A Message To Our Bloggers
Types of Telemedicine

I identify the following six distinct healthcare segments as:

  1. Life Sciences
  2. Pharma
  3. Med Device Manufacturers
  4. Care Provider
  5. Payers
  6. Public Health

I did not include Patients in the list as they are mostly content generators, consumers and have much to benefit from but they are on the mercy of other segments. Life Sciences and Pharma segments are already exploiting Big Data elements for OMICs in discovering new drugs and therapies and will discuss details in the later sections.

In this article, I will focus on realities of the Big Data in the Care Providers segments only.

To frame the discussion, let me describe what I mean by Big Data. The Big data consists of the following elements:

  • Content Attributes: 4 Vs (Volume, Variety, Velocity, Veracity) – widely known.
  • Technology Stack: Hadoop-like stacks and Analytics Appliances
  • Computing Model: Extremely Reliable Parallelism
  • Query Model: Hadoop/Map-Reduce use search method (not complex query). So if the intent is to do searches against large unstructured content, the pure Hadoop/map-reduce functions are good fit. Not SQL.
  • Connecting the Dots: Understanding the associative meanings of the interesting patterns hidden underneath massive content-stores.

Care Providers:

The Healthcare Provider segment is extremely fragmented. With ongoing Healthcare reforms, there is some hope that use of EHRs may result in some meaningful use of clinical content. Most of the CIOs are too busy in addressing ICD-10 and CMS Meaningful Use 2 mandates and very few have the time or energy to invest in true Big Data platforms. Data management still remains on the Legacy platforms. So how /where does Big Data fit in the Care Providers segment and challenges?

 

Data Jail

EHR vendors have a lock on patient clinical content in their own proprietary ‘Data Jails’. In my many years as a practitioner I have found it quite difficult to access clinical content and analyze it within these proprietary systems so the Volume and Velocity needed for Big Data is not easy to obtain.

I am using the term ‘Data Jail’ because it takes me back to the early 90′s, when ‘data jail’ term was widely used for the ERP vendors. Then, IT folks had hard time to pull data out of ERPs for reporting and analytics. Today, ERP vendors are quite open and allow accesses to the data. EHR vendors need to learn lessons from ERPs for openness, interoperability and scalability. Opening access to their repositories is good for their customers and for Big Data.

Complexity, Low Volumes and Static Data

 

Most clinical data volumes are quite low and static because you cannot change any historical data in a clinical record. Even though you may append a new record, the rate of change is fairly low unless you’re talking about genetic or proteomic data (which is rare in most settings). Moreover, Clinical content is quite complex. Here content context and semantics are more important than the volume and velocity so you can live with standard relational databases or analytics appliances without the Big Data tools like Hadoop.

 

Real-Time Patient Monitoring

Real-time patient monitoring applications such as bedside heart monitors, OR monitors for anesthesia, dialysis patient monitors, etc. are being piloted in care facilities that demand use of Big Data platform to quickly consume real-time events and signal possible life threatening adverse events before occurring. Increasing use of mobile personal health monitoring devices that stream data back to the care providers also require Big Data elements to capture and predict possible health issues and alarm the care takers and patient for actions. Good candidate for Big Data driven applications.

ACO Level Analytics

ACO level data volumes will be quite high and Big Data will play a key role to develop analytics. The challenge will be how to pull detailed clinical EHRs for the ACO and then to harmonize content in the ACO hub to ensure content quality. Lack of data exchange standards in practical use remains a problem. Even when vendors conform to patient data exchange standard, such as CCD, the actual implementation varies significantly and makes harmonization difficult. For example, Continuity of Care Document (CCD) implementation of two vendors could result in different patient clinical content. That’s because one vendor could provide latitudinal CCD while the other provided encounter specific CCD. Both conform to the CCD specs but payload was different. Here, for the ACO Big Data repository, you need to build a high performance harmonization engine to ensure content consistency before you embark on Analytics.

Valuing Big Data

After going through pain of Big Data implementations, the end goal should remain how to bring valuable insight back in the clinical processes – embedded within the clinical workflows. Most people think that just displaying charts and graphs on a stand-alone dashboard will do the job but of course that’s not the case. Physicians and clinicians do not have time to hop through many screens to care their patients. We need to embed such findings within the clinical work-flows so they have the right alert at the right time for the right patient. You may be stuck with an EHR’s limitations on how open they are so you may not be able to embed non-EHR event with their clinical workflows or work-lists.

Emerging Big Data Opportunity – Comparative Effectiveness Research

As social animals humans they socialize and chat about their daily life stories including dealing with their health issues, families, care givers, behaviors and medications. Such social communication is a gold mine to Pharma and Clinical Outcome researchers to understand effectiveness of a specific therapy. This new field is called the Comparative Effectiveness Research (CER) and Patient Centered Outcomes Research (PCOR). Through the use of Big Data analytics, CER will significantly improve patient care through development of personalized therapies.

Emerging Big Data Clinical Analytics providers

Last year, I served as a judge for the Massachusetts First Health Datapalooza competition. Several Big Data driven clinical applications were part of this competition. I had good discussions with a few vendors. Though their solutions are unique and valuable, none have thought well on how their solution will fit in the clinical setting, client EHR workflows or leverage client’s clinical platform. Just about all Big Data analytics providers are start-ups coming up with innovative care solutions.

When I see in the Big Data market place, it reminds me of ‘dot com’ era of the early 90′s. Lot of small innovative groups developing fascinating tools just like todays in the Healthcare world and unfortunately, a few will survive. My suggestion to such innovators is to keep in mind to develop their Big Data solution are interoperable with the EHRs or ACO business/clinical applications.

Closing thoughts

Big Data in the Clinical practice is just in its evolutionary stages. Most CIOs may be thinking about Big Data but to best of my knowledge I have not seen a pure Big Data implementation in any hospital or clinical practice. Only a handful of large global network of commercial Clinics have implemented such Big Data platforms in production.

Building a Big Data platform and having a team of skilled data scientists in a Hospital or Practice setting is not easy. It is Expensive as well. You will notice that today, only University Hospitals are starting to explore Big Data in the healthcare setting because of funded academic research programs and available pool of graduate students ready to investigate unexplored content. Same is true for the small start-ups companies to develop key healthcare analytics using the social data for public health and patient engagement applications. Today we are just taking baby steps — and we have a long road ahead of us to exploit the true value of Big Data in clinical settings.

Any thoughts or comments?

TAGGED:big data
Share This Article
Facebook Copy Link Print
Share

Stay Connected

1.5kFollowersLike
4.5kFollowersFollow
2.8kFollowersPin
136kSubscribersSubscribe

Latest News

Do You Grind Your Teeth at Night? Here’s How Night Guards and TMJ Treatments Can Help
Do You Grind Your Teeth at Night? Here’s How Night Guards and TMJ Treatments Can Help
Dental health
May 21, 2025
The Secret To A Confident Smile: Top Tips For Better Teeth
The Secret To A Confident Smile: Top Tips For Better Teeth
Dental health
May 21, 2025
Clinical Expertise
Building Smarter Care Teams: Aligning Roles, Structure, and Clinical Expertise
Health care
May 18, 2025
Grounded Healing: A Natural Ally for Sustainable Healthcare Systems
Grounded Healing: A Natural Ally for Sustainable Healthcare Systems
Health
May 15, 2025

You Might also Like

The Rise of Precision Medicine: Viable, but Challenge Lies Ahead

January 21, 2016

Make Your Blog Your Brand’s Patient Ed HQ

December 28, 2014
The Doc Smitty
Social Media

Patient Engagement with Facebook

July 30, 2015

Doctor Busted For Patient Information Inadvertently Exposed on Facebook

April 19, 2011
Subscribe
Subscribe to our newsletter to get our newest articles instantly!
Follow US
© 2008-2025 HealthWorks Collective. All Rights Reserved.
  • About
  • Contact
  • Privacy
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?