We use cookies, including third-party cookies from Google to serve personalized ads through AdSense, to operate this site and understand how it is used. By continuing to browse, you accept this use. See our Privacy Policy and Terms of Use for details, including how to opt out of personalized advertising.
Accept
Health Works CollectiveHealth Works CollectiveHealth Works Collective
  • Health
    • Mental Health
  • Policy and Law
    • Global Healthcare
    • Medical Ethics
  • Medical Innovations
  • News
  • Wellness
  • Tech
Search
© 2023 HealthWorks Collective. All Rights Reserved.
Reading: Consider MySQL ‘Archive’ Storage Engine to Store Large Amounts of Med Device Structured or Waveform Data
Share
Notification Show More
Font ResizerAa
Health Works CollectiveHealth Works Collective
Font ResizerAa
Search
Follow US
  • About
  • Contact
  • Privacy
© 2023 HealthWorks Collective. All Rights Reserved.
Health Works Collective > eHealth > Consider MySQL ‘Archive’ Storage Engine to Store Large Amounts of Med Device Structured or Waveform Data
eHealth

Consider MySQL ‘Archive’ Storage Engine to Store Large Amounts of Med Device Structured or Waveform Data

ShahidShah
ShahidShah
Share
4 Min Read
SHARE

I’ve been working on med device integrations for the many years now and one of the most common questions that arises when doing those integrations is “what’s the best way to save sensor waveform and analog to digital values?” Given the complexity of medical devices, there’s no single or simple answer but one approach that’s worked well for me in the past is to assume that whatever the data is, when it comes into digital format, it’s likely structured in some manner. If so, putting it into a database probably makes more sense in many cases than just dropping it into flat files (which is a common and very reasonable approach). If you want to store your data easily and without much hassle, give (free) open source MySQL a shot. Most of us who have been in the medical device world for even a little while tend to think that SQL is too heavyweight, but MySQL supports various storage engines that have different behaviors and storage goals. For instance, the standard InnoDB storage engine is an ACID compliant engine that allows full CRUD operations and is actually good when data integrity is crucial. Another storage engine is the ‘Archive’ engine — this is very useful when you want to just insert compressed, structured, data into the database and you want to pull data out at some point through a SQL SELECT clause. Archive engines do not have the ability to update or delete data but that’s OK for most of our med device data storage needs where we want continuously store and monitor data coming in through the system but won’t be modifying it. To learn more about MySQL’s Archive engine, check out the documentation on the MySQL site. Here is some relevant detail from that page that might save you some reading time:

Storage: Rows are compressed as they are inserted. The ARCHIVE engine uses zlib lossless data compression (see http://www.zlib.net/). There are several types of insertions that are used: An INSERT statement just pushes rows into a compression buffer, and that buffer flushes as necessary. The insertion into the buffer is protected by a lock. A SELECT forces a flush to occur, unless the only insertions that have come in were INSERT DELAYED (those flush as necessary). A bulk insert is visible only after it completes, unless other inserts occur at the same time, in which case it can be seen partially. A SELECT never causes a flush of a bulk insert unless a normal insert occurs while it is loading.
Retrieval: On retrieval, rows are uncompressed on demand; there is no row cache. A SELECT operation performs a complete table scan: When a SELECT occurs, it finds out how many rows are currently available and reads that number of rows. SELECT is performed as a consistent read. Note that lots of SELECT statements during insertion can deteriorate the compression, unless only bulk or delayed inserts are used. To achieve better compression, you can use OPTIMIZE TABLE or REPAIR TABLE. The number of rows in ARCHIVE tables reported by SHOW TABLE STATUS is always accurate.

TAGGED:HIT
Share This Article
Facebook Copy Link Print
Share

Stay Connected

1.5KFollowersLike
4.5KFollowersFollow
2.8KFollowersPin
136KSubscribersSubscribe

Latest News

Flat editorial illustration: Healthcare ethics-and-law training, shown through a coached clinical role-play where structured disc
Medical Ethics and the Law: The Training Behind Professionals Who Resolve Healthcare Disputes
Uncategorized
November 6, 2026
Flat editorial illustration: The article connects routine occupational health screening with early exposure detection and better
What Routine Workplace Health Monitoring in Medical Environments Actually Prevents
Uncategorized
November 6, 2026
Flat editorial illustration: The article contrasts structured prelicensure education with ongoing, practice-focused development f
Academic vs. Clinical Education: How Teaching Settings Shape Nursing Learners and Outcomes
Uncategorized
November 6, 2026
Flat editorial illustration: Health-editorial illustration of the two-way relationship between substance use and disrupted sleep,
How Sleep Disruption Feeds the Addiction Cycle and What You Can Do About It
Addiction Recovery Mental Health Wellness
November 6, 2026

You Might also Like

EHR
DiagnosticseHealthHealth ReformMedical InnovationsMedical RecordsTechnology

Why EHRs are Key to Better Clinical Data

April 29, 2014
google glass
eHealthMedical InnovationsMobile HealthTechnology

Why Google Should Buy Warby Parker – Before Jawbone

August 11, 2013
mhealth in thailand
eHealthMobile Health

Mobile Health Around the Globe: Thailand’s Vibhavadi Hospital Trials New Zealand mHealth System

August 5, 2013

NCQA Encourages Health IT Use Among Medical Specialists

August 4, 2012
Subscribe
Subscribe to our newsletter to get our newest articles instantly!
Follow US
© 2008-2026 HealthWorks Collective. All Rights Reserved.
  • About
  • Contact
  • Privacy
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?