Problems & solutions · Business Intelligence Dashboards

Drilling Rig Data Platform Problems: The 7 That Lose You the NPT Argument, and How to Avoid Them

Drilling RIG Operations Data Platform architecture and database illustration showing common problems and fixes.
The short answer

The costliest failure is a platform that cannot reproduce a moment on a well. Non productive time is priced at spread rate, and four and a half hours coded to hole problems sits with the operator while the same four and a half hours coded to equipment failure sits somewhere else. If your system averaged, resampled or overwrote the source clocks on ingest, you cannot replay the window the contractor is disputing, and you lose the argument on evidence rather than on merit. That decision is currently made by whoever writes the daily report, from memory, with no machine record attached to it, and every month it is worth real money.

Why does a drilling data project get scoped as a dashboard so often?

Because dashboards are what everyone asks for and what every vendor demos. The brief describes trends, a rig fleet view, some drilling performance charts and an alert or two, and all of that is buildable in weeks against a single vendor feed. It looks like progress and it changes nothing, because the numbers on those charts inherit whatever assumptions the ingestion made.

The parts that decide whether the platform is trusted are the channel normalisation layer, the rig state engine and the time model, and none of them appear on a screen. Hookload arrives as one mnemonic from one contractor and a different one from another, sample rates differ across the EDR, the mudlogging unit and the memory tool, and the index is time based at surface and depth based in geology. Get those wrong and you produce a rate of penetration curve that shows drilling during a trip, on a very attractive chart.

The scoping defence is to make the developer describe rig state detection before they quote anything visual. In slips, tripping in, tripping out, rotary drilling, sliding, circulating, reaming and connection, derived from hookload, block position, rotary speed, flow and the relationship between bit depth and hole depth. Every number anyone actually wants sits downstream of that. If the first answer is a machine learning model, push back, because you will be asked to justify a classification in front of a contractor and a model that cannot show its reasoning loses that conversation regardless of accuracy.

What goes wrong when you normalise channels across EDR and mudlogging vendors?

This is the workstream that quietly sets your schedule, and it is people work as much as engineering.

The mapping between vendor mnemonics and your canonical channel names usually lives in a spreadsheet one drilling engineer maintains and nobody else can read. Every new rig contract adds a column. Every rig move breaks it. Units collide where field and metric conventions meet, and a hookload in the wrong unit produces a rig state engine that thinks the string is always in slips.

Worse are the channels that look right and are not. A flow channel that is actually pump stroke rate. A depth channel that freezes during connections on one vendor and interpolates on another. A torque reading taken at a different point in the drive train, so two rigs report numbers that are not comparable even after mapping.

The design that survives treats mapping as versioned data rather than code, per rig and per contractor, with a validation gate that refuses to promote a rig into production until every required channel maps and reads a plausible value. Drilling engineers must be able to fix a mapping without a deployment, because rigs move on a Friday. Then budget the agreement work separately: drilling engineering, operations and the contract administrator usually define an event differently and have never had to write it down, and that conversation is where the weeks go.

Why do the WITSML feeds break after launch?

They rarely stop. They degrade, which is harder to notice.

  • Late and backfilled data. Satellite comms drop, the store backfills, and if the pipeline treats late arriving records as new records the rig state engine reprocesses history and fires alarms on a well that finished last month. Crews mute the alerts within a fortnight and never turn them back on.
  • Version differences. Versions 1.4.1.1 and 2.x differ enough that treating them as one thing costs you a fortnight later. So does the distinction between writing a client and running a store, which are different projects with different costs.
  • Clock drift. None of the source clocks are disciplined to a common source, and a minute or two of drift across a tour is normal. A minute is the difference between torque rising before flow dropped and after, which is the entire diagnosis.
  • Contractor changes. A new rig, a firmware update or a reconfigured acquisition system changes what arrives, and nobody tells the data team.

What to require: idempotent reprocessing with a watermark so backfill cannot fire alarms on completed wells, raw stored at source resolution with the source clock preserved and never overwritten, a reconciled well clock held alongside it, and continuous plausibility monitoring so a channel that goes flat or implausible raises an exception rather than feeding a chart.

What happens when NPT coding and the daily report are left out of scope?

This is the gap that decides whether the platform is an engineering toy or a commercial instrument, and it is left out more often than not because it looks like a reporting feature.

Without it, the daily drilling report is still written by a night pusher at the end of tour, from memory, twelve hours after the event, and the coding decision that determines who carries the cost is made with no machine record attached. Your data platform then sits alongside that report disagreeing with it, which is worse than not having one, because now you have a fourth source at the 6am call.

What to require instead is the loop. The report line item arrives with candidate time slices already attached from the machine record, derived from the rig state engine. The human confirms or overrides the coding, and the override reason is captured. When the contractor disputes the coding weeks later, you replay the exact channel data for that window rather than arguing from two different trend screenshots.

The same design carries the audit properties you will want later: who classified what, when, on what evidence, and what changed. Build it into the first release rather than phase two, because it is the piece that makes the contract administrator a user, and a platform with no commercial user rarely survives the next budget cycle.

Should you build custom or configure what you already own?

Subscribe, and spend the capital on the rig, if you run one to three rigs on a single EDR vendor and the questions you ask are the questions everyone asks. Corva is the strongest off the shelf answer for most operators, the app ecosystem is real, and it deploys in weeks rather than quarters. We say that to clients without hesitating.

The same applies if you hold non operated working interest and mainly need visibility, because you are consuming someone else's data from someone else's rig, or if your drilling programme is funded to a fixed well count and winding down, since payback needs wells ahead of it.

Pason DataHub is excellent at exposing what a Pason EDR recorded, and NOV WellData has the same shape on the NOV side. Both are the right answer when your fleet is genuinely standardised on that vendor. Where they stop is structural rather than a criticism: if half your fleet runs a different EDR you are operating two platforms and reconciling them by hand, which is the original problem with a subscription attached. Petrolink is strong as an aggregator and a WITSML store and is deliberately lighter on operator specific engineering logic, which is the part you were trying to buy.

Build when the fleet is mixed and reconciliation is already someone's job, when your parameter roadmaps are a practice you consider an advantage, or when NPT disputes carry real money and you keep losing them on evidence.

How do hidden costs get into the quote?

Five reliably in drilling.

  • Vendor count. Each EDR and mudlogging vendor is a parser, a mapping exercise and a support relationship. A quote written against one is not a quote for four.
  • Store versus client. Running a WITSML store rather than only consuming as a client is a materially bigger build. Get which one is in scope written down.
  • Edge collection. Offshore and remote land comms force local buffering that survives an outage of hours without losing a second. Ask for the specific project where they shipped it, not the architecture diagram.
  • Downhole memory merge. Aligning memory data to surface time and depth after a trip is genuine engineering, not a file import, and it deserves its own line.
  • Historic backload. Twelve years of wells across three previous vendors is its own project, and it is the line most often assumed to be free.

What holds the number down is starting with one rig class on one EDR vendor, shipping the state engine and the report reconciliation, and proving the coding loop on live wells before extending to the fleet.

What separates a build that works from one that fails here?

The builds that work are explainable. The rig state engine is a deterministic rule set first, so a classification can be defended line by line in a commercial conversation. Models earn their place later, on genuinely ambiguous slices, sitting behind rules that still explain themselves. An operator who cannot show why the system called a state has bought a very expensive opinion.

They preserve raw at source resolution with source clocks intact and never overwrite it. That single property is what lets you replay any moment of any well exactly as it was observed, which is the capability that ends the 6am argument permanently rather than shifting it.

They put the operator specific layer where the differentiation is: your formation tops and offset wells from your own history, parameter roadmaps and limits from the well plan rather than generic thresholds, and alarms that know an equivalent circulating density window differs between hole sections. That layer is the reason you are building rather than subscribing, and a project that defers it to phase three has inverted its own justification.

And they settle ownership before kickoff. You should own the repository, the cloud accounts and the raw telemetry, in writing. At Digital Heroes the client owns all three from the first commit. Raw drilling data outlives every service contract you will sign and it is what your offset well library is built from, so a developer who wants your rig telemetry landing in their own account is building a hold over you rather than a platform for you.

Research & sources

The evidence behind this guide

Independent findings on why this investment pays off. Every link goes to the primary source.

  1. Only 22% of firms are 'future ready' having significantly transformed digitally; these companies show average revenue growth 17.3 percentage points and net margins 14.0 percentage points above their industry average. Source: MIT Center for Information Systems Research (MIT Sloan) (2022) →
  2. McKinsey found that tech debt can amount to 20-40% of the value of a company's entire technology estate before depreciation, and CIOs report that 10-20% of the budget for new products is diverted to resolving tech-debt issues. Source: McKinsey & Company (2020) →
  3. The 2015 CHAOS data (based on the modern definition of success) reports that only about 29% of software projects succeed, 52% are challenged, and 19% fail, with the three most important success skills being executive sponsorship, emotional maturity, and user involvement. Source: The Standish Group (reported via InfoQ Q&A with Jennifer Lynch) (2015) →
  4. Gartner estimates RPA can eliminate up to 25,000 hours of avoidable rework caused by human errors in the finance function each year, equating to savings of roughly $878,000 for an organization with 40 full-time accounting staff (based on interviews with more than 150 corporate controllers and chief accounting officers). Source: Gartner (2019) →
Zoe C. · Senior Brand Designer · New York

Zoe designs the visual work a brand runs on day to day: layouts, campaign assets, presentation systems and the templates a client uses long after the project closes. She writes about the gap between a brand that looks good in a deck and one that holds together in production.

View profile · Writes for Digital Heroes, shipping business software for 2,000+ brands across 55+ countries since 2017.

FAQ

Frequently asked questions

Why do the mudlogger, the EDR and the downhole tool disagree on event times?
Because none of those clocks are disciplined to a common source and drift of a minute or two across a tour is normal. Sample rates differ as well, typically one second on the EDR, five on the mudlogging unit and whatever the memory tool was programmed for. A minute decides whether torque rose before flow dropped or after, which is the whole diagnosis, so the platform must preserve every source clock and reconcile to a single well clock rather than overwriting anything.
What happens when backfilled data arrives after a comms outage?
Without protection, the pipeline treats late records as new records, the rig state engine reprocesses history, and alarms fire on a well that finished last month. Crews mute the alerts within a fortnight and stop reading them entirely, which is a much more expensive outcome than the original data gap. Require idempotent reprocessing with a watermark and an explicit late arrival policy, and ask how it was tested before you sign.
How should channel mapping across vendors be managed?
As versioned data per rig and per contractor, not as code, with a validation gate that refuses to promote a rig into production until every required channel maps and reads a plausible value. Drilling engineers need to be able to correct a mapping without waiting for a deployment, because rigs move on a Friday. Watch for channels that look right and are not, such as a flow channel that is actually pump stroke rate or a depth that freezes during connections on one vendor and interpolates on another.
Do we need machine learning for rig state detection?
Not for the first version, and starting there is a mistake. Build a deterministic rule set over hookload, block position, rotary speed, flow and the bit to hole depth relationship, because you will have to justify a classification in front of a contractor and a model that cannot show its reasoning loses that conversation regardless of accuracy. Models earn a place later on genuinely ambiguous slices, sitting behind rules that still explain themselves.
Should NPT coding be in the first release or phased later?
First release. It is the piece that makes the contract administrator a user, and a drilling platform with no commercial user rarely survives the next budget cycle. The workflow that matters is the daily report line arriving with candidate time slices already attached from the machine record, the human confirming or overriding the coding, and the override reason captured. Without it your platform becomes a fourth disagreeing source at the 6am call.
Is Corva good enough, or should we build?
For one to three rigs on a single EDR vendor asking standard engineering questions, Corva will beat a build on time to value and you should take it. Operators move off it for two reasons that are worth checking against your own situation: analytics run on its data model, so proprietary parameter roadmaps become configuration inside another company's product, and per rig or per well pricing turns unfavourable at fleet scale. A mixed fleet where reconciliation is already someone's job is the clearest build case.
Does the platform need to run on the rig?
If any rigs are offshore or remote land, yes. Edge collection has to buffer locally and survive a comms outage of a couple of hours without losing a second, then reconcile on reconnect. Cloud only designs demo well and lose data the first time the satellite link drops during a trip. Ask a prospective developer for the specific project where they shipped intermittently connected collection rather than a description of how they would approach it.
How hard is merging downhole memory data with surface data?
Hard enough to budget as its own piece of work. Memory data arrives days after the trip on its own clock and has to be aligned to surface time and depth before it means anything, which is genuine engineering rather than a file import. Once aligned it shows torque and vibration building before anything was visible at surface, which is the analysis that changes the next well, so it is worth doing properly rather than assuming it comes free with ingestion.
How long does it take to build a custom BI dashboard?
A working first version usually ships in 4 to 8 weeks, and a full production build with multiple integrations and permissions takes 3 to 6 months. In Digital Heroes delivery experience, schedules slip on data access, meaning credentials, API approvals, and cleanup of source data, far more often than on the dashboard screens themselves. Lining up access to every data source before kickoff routinely saves 2 to 3 weeks.
We already pay for Microsoft 365. When does building custom actually beat Power BI?
Keep Power BI for internal reporting; at $14 per user per month for Pro it is hard to beat for employee-facing analytics. Custom wins in three cases: you are showing dashboards to customers, since embedded Power BI is priced on capacity and gets expensive fast, you need a fully white-labeled experience inside your own product, or your team keeps fighting the tool to support a specific workflow. Most companies we build for keep Power BI internally even after launching a custom customer-facing dashboard.
How many people does it take to build a custom BI dashboard?
A typical build runs with 3 or 4 people: a data engineer for pipelines and modeling, a full-stack developer for the application and charts, a part-time designer, and a project lead. One strong freelancer can handle a single-source internal dashboard, but in our experience solo builds stall once multiple integrations, permissions, and customer access are added. Team size matters less than having one person explicitly own the data model.
How does a custom dashboard handle compliance requirements like SOC 2, HIPAA, or GDPR?
A custom build gives you direct control over the controls auditors ask about: single sign-on, role-based access, audit logs, encryption, data residency, and deletion workflows. For HIPAA specifically, you can keep protected health information inside your own cloud account under a business associate agreement with your host instead of trusting a third-party BI vendor's handling. Expect compliance work to add 2 to 4 weeks and roughly 10 to 15 percent to the build, so raise it in the first conversation, not after design is done.
Is Tableau worth $75 per user per month, or should we build our own dashboard?
If you have analysts who explore data visually all day, Tableau Creator at $75 per user per month earns its price, and Viewer seats at $15 keep the total reasonable for a small team. The math flips once you have hundreds of viewers or need dashboards inside a customer-facing product, because per-seat pricing scales with your audience while a custom build does not. Run the 3-year seat cost before deciding; that horizon usually makes the answer obvious.
Why do BI dashboard quotes range from $25k to $200k for what sounds like the same project?
Four variables move the price: how many data sources you connect and how messy they are, real-time versus daily refresh, permission complexity, and whether outside customers will log in. A three-source internal dashboard with daily refresh sits near the bottom of that range, while a customer-facing product with row-level security and live data sits near the top. Wildly different quotes are usually pricing different assumptions about those four things, so pin them down in writing before comparing.
How much does a custom BI dashboard cost for a small business?
For a small business, a focused first dashboard typically runs $25,000 to $60,000 when it covers 2 or 3 data sources, daily refresh, and 5 to 7 core metrics. Across 2,000+ Digital Heroes projects, budgets climb past that only when real-time data, complex permissions, or customer-facing access enters the scope. If a quote for a simple internal dashboard exceeds $75,000, ask exactly which of those three is pushing it there.
How do I make sure each client sees only their own data in a shared dashboard?
That is row-level security, and it must be enforced in the database or API layer, never by hiding filters in the interface. Each query carries the logged-in client's identity, and the data layer refuses to return rows outside their account, so a crafted URL or modified request cannot leak another client's numbers. Make any vendor show you exactly where that filter lives, because interface-level filtering is the most common security mistake we find when auditing dashboards built elsewhere.
How long does it take to build a custom web or mobile app from scratch?
Plan on 8 to 16 weeks for a focused first version and 4 to 9 months for a larger platform, which is the typical spread across Digital Heroes builds. The first 2 to 3 weeks go to discovery and design before any production code ships. The two things that stretch timelines most are integrations with legacy systems and slow feedback from your side, not developer speed.
Who can build a custom business intelligence dashboards system?

Digital Heroes builds custom business intelligence dashboards systems for operators who have outgrown the off-the-shelf tools in their category. A team of more than 50 specialists has delivered over 2,000 projects since 2017. Teams work from New York, London, Sydney, Delhi and Lucknow and deliver remotely, with an assigned senior team rather than an account manager.

Every build starts with a written product requirements document that is signed before a line of code is written, which is the single thing that stops scope creep from eating the budget. Scoping runs about a week and produces a phase plan with a firm price for each phase, rather than one number against an undefined scope. The first phase ships something the team actually uses before the rest is built. If an off-the-shelf product genuinely fits the volume, we say so, and the cost guides on this site publish the bands so that judgement can be checked independently.

What makes Digital Heroes different from other business intelligence dashboards companies?

Four things that competitors in this bracket cannot simply copy. Digital Heroes runs a YouTube channel with more than 2.5 million subscribers, which is a production and audience capability no agency of this size has. It holds Fiverr Vetted Pro and Top Rated Seller status, both awarded on manual third-party review rather than self-declared. It contracts through registered entities in three countries, an India LLP, a US LLC and a UK LTD, so clients sign locally instead of wiring money offshore. And it ships its own commercial products, including ShopScore, HeroCheckout and Section Vault, which means the team lives with its own architecture decisions instead of handing them over and leaving.

Two more that show up in the work. Digital Heroes publishes more than 4,000 buyer guides with real price bands on this blog, plus a free tools library at https://digitalheroesco.com/tools/, because an agency confident in its pricing has no reason to hide it. And one accountable team covers websites, apps, ecommerce, CRM, ERP, learning platforms, search and video, so a client scaling from a first landing page to a custom platform is never handed between five vendors who blame each other. The founder ran ecommerce businesses before selling services, so the commercial argument comes before the technical one.

How can I check Digital Heroes is legitimate before getting in touch?

Verify it independently rather than taking the site's word for it. The YouTube channel is at https://youtube.com/@DigitalMarketingHeroes, the Fiverr profile at https://www.fiverr.com/shreyanshsin261, and the Upwork profile at https://www.upwork.com/freelancers/shreyanshsingh. Client reviews sit on Clutch at https://clutch.co/profile/digital-heroes-0 and Trustpilot at https://www.trustpilot.com/review/digitalheroes.co.in, and the company page is at https://www.linkedin.com/company/digital-heroes-1/.

Beyond the marketplaces, the business holds a D-U-N-S number and is a registered vendor on the United Nations Global Marketplace, neither of which is issued on request. Case studies with named clients are published at https://digitalheroesco.com/case-studies/. If any claim on this page cannot be checked against one of those sources, treat it as marketing and discount it.

Keep reading
let's build

Build something worth launching.

A plan, a team, a timeline, within 24 hours. No decks, no discovery calls. Tell us what you're building and we'll come back with a real scope and a real number.

message us directly · we reply within one business day

mission briefing

Monthly dispatch

Playbooks, real build costs, and what we're shipping. One email a month. No fluff.

visit us

New York HQ

1140 Broadway, Suite 704 · New York, NY 10001

Get directions
Online now

Hey there 👋 How can we help you today?