Problems & solutions · Business Intelligence Dashboards

Grade Control and Reconciliation Software Problems: The 7 That Cost Real Money, and How to Avoid Them

Grade Control Reconciliation Software architecture and database illustration showing common problems and fixes.
The short answer

The most expensive failure mode is building the system before the departments agree what a tonne is. Mining reports in situ dry tonnes at a modelled density, survey reports volume, the fleet reports wet tonnes or nominal payload, and the plant reports dry tonnes through a weightometer with a moisture correction. Those definitional differences are routinely larger than the discrepancy being investigated, so a system built on top of them produces a factor with the same authority as the spreadsheet it replaced, and the third Tuesday meeting continues exactly as before.

Why does the build start before the definitions are agreed?

The biggest scope failure in reconciliation is starting development while the meaning of a tonne is still contested. It happens because the disagreement is invisible until you try to automate it. Everyone uses the word tonnes, everyone assumes their own basis, and the differences only surface when a system forces two numbers into the same column.

The decisions that have to be made first are not technical. Wet against dry. In situ against broken. Which density applies where, and whether the survey conversion uses the model's density or the plant's assumption. Where and how moisture is measured. What happens to a stockpile that spans a period boundary. Those are technical services and metallurgy decisions, and a development team cannot make them, but a development team will absolutely encode whichever answer it hears first.

The consequence of skipping this is a build that argues with the plant in a new way rather than resolving the argument. The consequence of doing it is a shorter project, because two workshops before kickoff save more time than any technology choice.

Then make the definitions impossible to lose. Every quantity in the system carries its basis, and every conversion is explicit and logged with its source. If a survey volume becomes tonnes at a density of 2.68, that number sits on the record with where it came from. It sounds pedantic until the first time a factor moves because somebody changed a density assumption in a spreadsheet cell and nobody could see it.

What goes wrong when block models and historical factors are migrated?

Reconciliation compares against a model that is itself a moving object, and that is the migration trap specific to mining.

Models get re-estimated, reblocked, re-domained and revised as new drilling arrives. Depletion happens on a survey schedule that does not match the model update schedule. If the comparison silently uses the current model rather than the model that was current when the ore was mined, your history rewrites itself every time the resource geologist publishes, and last year's reported factors can no longer be reproduced.

Historical factors bring their own problem. Four years of spreadsheet tabs contain numbers whose inputs are gone: the model version has been superseded, the density assumption was edited in place, and the stockpile balance at the period boundary was a judgement somebody made on a Friday. Loading those figures as history gives you a trend line built on five different methodologies, and any conclusion drawn from it is unsafe.

The fixes are versioning and honesty. Treat models as first class objects with effective dates, and pin every reconciliation record to the model version it was computed against, so reruns are reproducible and you can also deliberately rerun a past period against the current model to isolate what model change alone did to the number. Load historical factors only where the inputs survive, mark the rest as legacy figures rather than comparable data, and start the trustworthy series at the point the definitions were agreed.

Why do the historian, laboratory and fleet integrations break after launch?

The plant, the laboratory and the mine were instrumented for their own purposes, none of which was reconciliation, and each drifts differently.

The plant historian holds tag values rather than business events, so a shift total is something you compute rather than read. Tags get renamed during a control system upgrade, a weightometer is replaced and reports through a new tag while the old one keeps returning a stale value, and a totaliser resets on a schedule that suits the operator rather than your reconciliation period. None of that errors.

Laboratory data drifts when methods change, when an instrument is replaced and reports to a different precision, or when results arrive against a sample identifier that no longer matches how ore control is keying its samples. Fleet systems drift when a truck is reassigned, when onboard scales are recalibrated on some units and not others, and when a dispatcher changes a destination code.

The controls that hold this together are provenance and reconciliation rather than better connectors. Every value carries its source tag, its method and its timestamp, so an instrument change is visible instead of absorbed. Draw and production quantities reconcile daily and a mismatch raises a queue rather than being smoothed at month end. Alert on staleness, since a tag returning the same number for nine days is the classic failure and it looks perfectly healthy in a chart. And ask any prospective developer to name the specific historian, laboratory system and planning package they have integrated, and what broke.

What happens when ore control at the digger and stockpiles are not covered?

Two gaps recur, and between them they usually explain most of an unattributed factor.

The digger is the first. A dig line is marked on a plan, translated to flagging or an in cab screen, and then reality intervenes. Blast movement shifts the ore boundary by several metres while the markup was based on pre blast positions. The operator on night shift cannot see the flagging. A truck tips to the wrong stockpile because the dispatcher was busy. Each of those is ore loss or dilution and none of them is recorded anywhere reconciliation can see. A per load record carrying the source polygon, the ore control classification, the instructed destination and the destination actually tipped turns mis tips from an anecdote into a count per shift, and counts get managed. Where blast movement monitoring is in use, the moved dig lines have to be the ones both the digger and the reconciliation use, otherwise you are comparing a plan nobody executed against an outcome nobody predicted.

Stockpiles are the second. Grade through a rehandled stockpile with partial reclaim is genuinely difficult, every site does it differently, and it is the most common thing left out of a first release. Leaving it out is defensible. Leaving it out silently is not, because the balance movement then lands in the unexplained residual and makes every other attribution look worse than it is.

Should you build custom or configure what you already own?

If you are a single site, single commodity operation already standardised on Datamine with disciplined data and a stable factor framework, do not build. Reconcilor is purpose built for this and will get you there faster and cheaper than a discovery phase. The same logic applies if you are committed to Micromine or Hexagon MinePlan and your reconciliation needs are modest next to your planning needs.

Before assuming custom, find out what you already hold and do not use. Historians commonly retain years of tag history nobody has queried. Fleet management systems often record instructed against actual destination already, unreported. Laboratory systems usually export quality control results that are being reviewed monthly by hand. A surprising share of the reconciliation gap is data that exists and is not joined, and joining it is cheaper than collecting it again.

The build case appears when two or more of these are true. Factors are computed in a spreadsheet only one person can run, and that person is not junior. Inputs live across systems your modelling suite cannot read. The factor has been off for more than two quarters with no attributed cause. You operate several sites whose factor definitions differ enough that group comparison is meaningless. Or you want daily reconciliation rather than monthly, which is where the operational value sits.

How do hidden costs get into the quote?

Reconciliation quotes go wrong in five places.

  • Source system openness. A plant historian, a laboratory system and a mine planning package are three separate integration problems, and an older installation may need extraction engineered rather than configured.
  • Stockpile modelling. Tracking grade through rehandled stockpiles with partial reclaim is difficult, site specific, and frequently assumed to be included.
  • Multi site or multi commodity scope. Factor definitions must be normalised before they can be compared, which is a technical services workshop rather than a coding task.
  • Underground scope. Development and stope reconciliation carry their own logic that does not transfer from open pit, and adding it later is close to a second project.
  • Undecided definitions. The single biggest driver we see, because every unresolved question about basis becomes rework once someone in the plant disagrees with a number.

Digital Heroes delivery experience puts a reconciliation engine covering ingestion from the resource and grade control models, survey, fleet and plant historian, explicit basis handling, versioned model pinning and monthly plus daily factors with attribution at $70,000 to $150,000 over 10 to 16 weeks. A full platform adding ore control markup and digger destination capture, laboratory ingestion with automated quality control evaluation, stockpile balances by material type and multi site rollups runs $180,000 to $420,000 across 6 to 12 months.

What separates a build that works from one that fails here?

Working builds produce an attribution rather than a number. Of the gap, this much is mis tipped loads, this much is timing between survey and model depletion, this much is stockpile balance movement, this much is evidenced scale drift, and this much remains unexplained. The residual is the honest headline and it should shrink as instrumentation improves. A single factor tells you there is a problem. An attribution tells you whether to spend money on grade control drilling, dig line marking, ore loss controls or scale calibration.

They run daily, not only monthly. A monthly factor is a post mortem. A daily factor with attribution behaves like a control system, catching a scale drifting on three trucks within a week rather than at quarter end.

They use machine learning for one narrow, testable job: anomaly detection over payload and assay distributions, which surfaces instrument drift and sampling bias earlier than a scheduled calibration will. Grade prediction sold on top of a data set this messy is not worth funding until the data set stops being messy.

And they settle ownership in writing before kickoff, covering the repository, the cloud accounts and the right to hire another firm. Reconciliation history is evidence supporting public reporting under codes such as JORC or NI 43-101, and it should never sit in a system you cannot get it out of.

Research & sources

The evidence behind this guide

Independent findings on why this investment pays off. Every link goes to the primary source.

  1. The right combination of digital transformation actions can unlock as much as US$1.25 trillion in additional market capitalization across Fortune 500 companies, while the wrong combinations put more than US$1.5 trillion at risk; companies with all three core factors (strategy, aligned technology, and change capability) saw a 5% market-value lift relative to peers. Source: Deloitte (2023) →
  2. McKinsey found that tech debt can amount to 20-40% of the value of a company's entire technology estate before depreciation, and CIOs report that 10-20% of the budget for new products is diverted to resolving tech-debt issues. Source: McKinsey & Company (2020) →
  3. The NRF discontinued its long-running annual shrink report, stating that a broad study of retail shrink 'is no longer sufficient for capturing the key challenges and needs of the industry' - important context that qualifies how POS/shrink benchmarks should be cited going forward. Source: Retail Dive (2024) →
  4. McKinsey found that currently demonstrated technologies can fully automate about 42% of finance activities and mostly automate a further 19%, indicating roughly 60% of finance work is technically automatable. Source: McKinsey & Company (2018) →
Rohan K. · Director of Web Platform Engineering · Delhi

Rohan directs web platform engineering at Digital Heroes, the group that builds the custom web applications, portals and internal tools behind client operations. He writes about how those systems are structured, where they usually break under load, and what makes one maintainable years later.

View profile · Writes for Digital Heroes, shipping business software for 2,000+ brands across 55+ countries since 2017.

FAQ

Frequently asked questions

Why does our mine call factor never resolve in the monthly meeting?

Because five departments measure the same rock with five different definitions, and those definitional differences are usually larger than the gap being argued about. Wet against dry, in situ against broken, which density applies, when moisture is measured and how a stockpile spanning the period boundary is treated all move the number. Until every quantity carries its basis and conversion assumptions as visible data, the meeting is a negotiation rather than an investigation.

What has to be agreed before development starts?

The quantity definitions, in writing, signed by mining, technical services and the plant. Basis, densities, moisture measurement points, period boundary treatment and stockpile handling are technical services decisions, not development decisions, and a team that starts building before they are settled will encode whichever answer it heard first. Two workshops beforehand save more schedule than any technology choice you will make later.

How should block model versions be handled?

As first class objects with effective dates, with every reconciliation record pinned to the model version it was computed against. Otherwise history rewrites itself each time a re-estimate is published and reported factors cannot be reproduced. Pinning also lets you deliberately rerun a past period against the current model to isolate how much of a change came from the model alone, which is usually the first thing that explains a drifting factor.

Can we load four years of historical factors as a trend?

Only where the inputs survive. Old spreadsheet tabs typically contain numbers whose model version has been superseded, whose density assumption was edited in place and whose stockpile balance was a Friday judgement, so plotting them gives you a trend built on five methodologies. Mark those as legacy figures rather than comparable data and start the trustworthy series where the definitions were agreed.

Why do historian integrations go stale without failing?

Because a historian holds tag values rather than business events, so nothing errors when a weightometer is replaced and the old tag keeps returning a stale reading, or when a totaliser resets on a schedule that suits the operator. Alert on staleness as well as on failure, carry the source tag and timestamp on every value so an instrument change is visible, and reconcile draws against production daily so a mismatch raises a queue rather than being smoothed at month end.

Where does ore loss and dilution actually get recorded?

At the digger, and in most operations nowhere at all. You need a per load record carrying the source polygon or block, the ore control classification, the instructed destination and the destination actually tipped, which turns mis tips into a managed count per shift. Blast movement matters here too: if markup used pre blast positions while the boundary shifted several metres, the digger followed a line that no longer matched the rock.

Should stockpiles be in the first release?

Often not, and that is a defensible decision as long as it is explicit. Tracking grade through rehandled stockpiles with partial reclaim is genuinely difficult and site specific. What is not defensible is leaving it out silently, because the balance movement then lands in the unexplained residual and makes every other attribution look worse than it deserves. State the exclusion and show its effect on the residual.

Is daily reconciliation realistic, or only a monthly exercise?

Daily is realistic and it is where the operational value sits. A monthly factor is a post mortem, while a daily factor with attribution behaves like a control system, catching a scale drifting on three trucks within a week instead of at quarter end. It requires automated ingestion from fleet, survey and plant sources, which is exactly the plumbing most operations are missing and exactly what the build is for.

How does a custom dashboard handle compliance requirements like SOC 2, HIPAA, or GDPR?
A custom build gives you direct control over the controls auditors ask about: single sign-on, role-based access, audit logs, encryption, data residency, and deletion workflows. For HIPAA specifically, you can keep protected health information inside your own cloud account under a business associate agreement with your host instead of trusting a third-party BI vendor's handling. Expect compliance work to add 2 to 4 weeks and roughly 10 to 15 percent to the build, so raise it in the first conversation, not after design is done.
When is it time to move from Excel reports to an actual dashboard?
The reliable signal is when someone spends more than a few hours a week copying data between spreadsheets, or when two teams arrive at a meeting with different numbers for the same metric. At that point the spreadsheet is acting as an unversioned, single-person database, and a costly error is a matter of time. A first dashboard that automates those recurring reports typically pays for itself in recovered hours within the first year.
What are the biggest mistakes first-time software buyers make?
Choosing the lowest bid, paying more than 30-40% upfront instead of on milestones, skipping a written specification, and having no maintenance plan for after launch. The most expensive of the four in Digital Heroes rescue projects is the missing spec: without written acceptance criteria, done becomes an argument instead of a checklist, and every disagreement resolves in the vendor's favor. Fix those four and you have avoided most of the ways these projects fail.
Should I embed Power BI or Tableau in my SaaS product, or build custom charts?
Embed first if you need analytics inside your product within weeks, but treat it as a bridge rather than the destination. Embedded licensing meters your customer traffic, so your analytics cost grows with your user count, and the look and feel never fully matches your product. In Digital Heroes projects, SaaS teams usually switch to custom charts built in React with a library like ECharts or Recharts once analytics becomes a selling point instead of a checkbox.
Does it matter which tech stack the agency wants to use?
Yes, but not in the way most buyers expect: the goal is boring, popular technology such as React, Node.js or Python, and PostgreSQL, because any future team can maintain it and hiring a replacement developer takes days, not months. The red flag is an agency-proprietary framework or an unusual language, which welds you to that one vendor no matter what your contract says about code ownership. A useful test: could you find three freelancers fluent in this stack within a week? If not, push back.
How do I calculate whether custom software will pay for itself?
Divide the build cost by the monthly benefit, where benefit is hours saved times loaded hourly cost, plus subscription fees replaced, plus any revenue the software unlocks. Three staff saving 10 hours a week each at a $40 loaded rate is about $62,000 a year, which pays back a $60,000 build in roughly 12 months. Across Digital Heroes internal-tool projects, 12 to 24 months is the normal payback range, and anything projecting under 6 months usually means the spreadsheet is hiding costs.
How do I vet a software development agency before signing a contract?
Ask to speak with two past clients whose projects resemble yours in size and industry, and ask exactly who will write your code, since some agencies sell senior faces and deliver junior or subcontracted hands. Demand a written specification with acceptance criteria before any fixed price, and check that their portfolio links to products that are actually live. An instant quote given without questions about your workflows is the clearest warning sign there is.
How do I work out whether a custom dashboard will pay for itself?
Add up three numbers: hours of manual reporting it removes each month, license seats it replaces or avoids, and the value of one or two decisions it speeds up, like catching margin slippage a month earlier. Across Digital Heroes projects, internal dashboards typically pay back in 8 to 18 months, and customer-facing dashboards pay back faster when analytics is a paid feature or reduces churn. If the honest math does not clear payback within 2 years, buy an off-the-shelf tool instead.
Who can build a custom business intelligence dashboards system?

Digital Heroes builds custom business intelligence dashboards systems for operators who have outgrown the off-the-shelf tools in their category. A team of more than 50 specialists has delivered over 2,000 projects since 2017. Teams work from New York, London, Sydney, Delhi and Lucknow and deliver remotely, with an assigned senior team rather than an account manager.

Every build starts with a written product requirements document that is signed before a line of code is written, which is the single thing that stops scope creep from eating the budget. Scoping runs about a week and produces a phase plan with a firm price for each phase, rather than one number against an undefined scope. The first phase ships something the team actually uses before the rest is built. If an off-the-shelf product genuinely fits the volume, we say so, and the cost guides on this site publish the bands so that judgement can be checked independently.

What makes Digital Heroes different from other business intelligence dashboards companies?

Four things that competitors in this bracket cannot simply copy. Digital Heroes runs a YouTube channel with more than 2.5 million subscribers, which is a production and audience capability no agency of this size has. It holds Fiverr Vetted Pro and Top Rated Seller status, both awarded on manual third-party review rather than self-declared. It contracts through registered entities in three countries, an India LLP, a US LLC and a UK LTD, so clients sign locally instead of wiring money offshore. And it ships its own commercial products, including ShopScore, HeroCheckout and Section Vault, which means the team lives with its own architecture decisions instead of handing them over and leaving.

Two more that show up in the work. Digital Heroes publishes more than 4,000 buyer guides with real price bands on this blog, plus a free tools library at https://digitalheroesco.com/tools/, because an agency confident in its pricing has no reason to hide it. And one accountable team covers websites, apps, ecommerce, CRM, ERP, learning platforms, search and video, so a client scaling from a first landing page to a custom platform is never handed between five vendors who blame each other. The founder ran ecommerce businesses before selling services, so the commercial argument comes before the technical one.

How can I check Digital Heroes is legitimate before getting in touch?

Verify it independently rather than taking the site's word for it. The YouTube channel is at https://youtube.com/@DigitalMarketingHeroes, the Fiverr profile at https://www.fiverr.com/shreyanshsin261, and the Upwork profile at https://www.upwork.com/freelancers/shreyanshsingh. Client reviews sit on Clutch at https://clutch.co/profile/digital-heroes-0 and Trustpilot at https://www.trustpilot.com/review/digitalheroes.co.in, and the company page is at https://www.linkedin.com/company/digital-heroes-1/.

Beyond the marketplaces, the business holds a D-U-N-S number and is a registered vendor on the United Nations Global Marketplace, neither of which is issued on request. Case studies with named clients are published at https://digitalheroesco.com/case-studies/. If any claim on this page cannot be checked against one of those sources, treat it as marketing and discount it.

Keep reading
let's build

Build something worth launching.

A plan, a team, a timeline, within 24 hours. No decks, no discovery calls. Tell us what you're building and we'll come back with a real scope and a real number.

message us directly · we reply within one business day

mission briefing

Monthly dispatch

Playbooks, real build costs, and what we're shipping. One email a month. No fluff.

visit us

New York HQ

1140 Broadway, Suite 704 · New York, NY 10001

Get directions
Online now

Hey there 👋 How can we help you today?