Failure To Recalibrate Fraud Models After Incident Learnings .

1. Introduction

Failure to publish benchmark methodology transparently refers to a situation where an organisation, government authority, regulatory body, evaluation committee, institution, or other decision-making authority uses a benchmark, scoring system, ranking mechanism, performance indicator, or assessment criteria without adequately disclosing the methodology on which that benchmark is based.

A benchmark methodology generally explains:

The criteria used for evaluation.

The parameters and indicators considered.

The weightage assigned to each parameter.

The formula or calculation method adopted.

The sources of data relied upon.

The standards against which performance is measured.

The procedure for verification and validation.

The method of dealing with errors, inconsistencies, and objections.

Transparency requires that affected persons should be able to understand how a benchmark was developed, how it is applied, and how the resulting decision was reached.

Where a public authority uses an undisclosed or unexplained methodology to determine eligibility, rankings, selection, financial entitlements, performance, or other consequential matters, the decision may raise serious concerns relating to arbitrariness, procedural unfairness, violation of natural justice, lack of accountability, and infringement of Article 14 of the Constitution of India.

The central legal principle is that a public authority cannot exercise its discretion arbitrarily or make consequential decisions through undisclosed, irrational, or inconsistently applied standards.

2. Meaning and Importance of Benchmark Methodology

A benchmark is a reference standard used to measure, compare, evaluate, or assess performance or compliance.

For example:

A government authority establishes a benchmark to evaluate the performance of institutions.

A recruitment agency adopts a scoring methodology to shortlist candidates.

A regulatory authority determines financial or technical standards.

A public institution ranks applicants using predetermined evaluation parameters.

An assessment body establishes performance indicators for determining eligibility.

The methodology behind such a benchmark is important because the final result depends upon the underlying parameters and their relative importance.

Without disclosure of the methodology, an affected person may know the outcome but remain unaware of how that outcome was reached.

This creates an accountability problem because it becomes difficult to determine whether the benchmark was reasonable, objective, consistent, and free from arbitrary considerations.

3. Legal Framework Under Indian Law

A. Article 14 – Equality Before Law and Protection Against Arbitrariness

Article 14 of the Constitution guarantees equality before the law and equal protection of the laws.

The principle of Article 14 extends beyond discrimination in its narrow sense. It also prohibits arbitrary, unreasonable, irrational, and unfair State action.

When an authority introduces a benchmark without disclosing its methodology, several legal questions arise:

Whether the benchmark was formulated on objective and rational considerations.

Whether the criteria were predetermined or introduced subsequently.

Whether the same methodology was applied uniformly to all affected persons.

Whether the authority has selectively applied certain parameters.

Whether the affected persons were denied a reasonable opportunity to understand or challenge the assessment.

Whether the decision was influenced by irrelevant or extraneous considerations.

An undisclosed methodology becomes particularly problematic when it determines the rights, eligibility, ranking, or financial interests of individuals or institutions.

Legal proposition: A public authority must exercise its powers in a fair, reasonable, non-discriminatory, and non-arbitrary manner.

B. Article 19(1)(g) – Fairness in Economic and Professional Activities

Where benchmark-based decisions affect businesses, professionals, service providers, or commercial entities, Article 19(1)(g) may also become relevant.

For example, an undisclosed benchmarking system may affect:

Eligibility to participate in commercial activities.

Allocation of contracts.

Recognition of professional qualifications.

Access to regulatory benefits.

Institutional accreditation.

Commercial rankings and performance classifications.

However, Article 19(1)(g) is subject to reasonable restrictions under Article 19(6). Therefore, non-publication does not automatically establish a constitutional violation. The circumstances and consequences of the undisclosed methodology must be examined.

C. Principles of Natural Justice

The principles of natural justice require fairness in administrative decision-making.

Two important principles are:

Audi alteram partem: No person should be condemned unheard.

Nemo judex in causa sua: No person should be a judge in their own cause.

Where an authority uses an undisclosed benchmark to reach an adverse decision, the affected person may be unable to respond effectively because the basis of the decision remains unknown.

For meaningful representation, the affected person should ordinarily have sufficient information about the relevant criteria, calculations, and reasons, subject to legitimate confidentiality restrictions.

D. Right to Information Act, 2005

The Right to Information Act, 2005, provides another important legal framework.

Relevant provisions include:

Section 4(1)(b): Requires public authorities to proactively disclose specified categories of information, including the particulars of facilities available to citizens, the norms set for the discharge of functions, and other prescribed organisational information.

Section 4(1)(c): Requires publication of relevant facts while formulating important policies or announcing decisions that affect the public.

Section 4(1)(d): Requires public authorities to provide reasons for their administrative or quasi-judicial decisions to affected persons.

Section 6: Enables citizens to request information from public authorities.

Section 8: Provides exemptions from disclosure in specified circumstances, including certain confidential, commercial, and protected information.

Therefore, where a public authority has relied upon a benchmark methodology, relevant records may be sought under the RTI Act, including the approved methodology, evaluation criteria, calculation sheets, weightage, and reasons for adopting the benchmark, subject to applicable exemptions.

Importantly, the RTI Act does not mean that every methodology must invariably be published in full. The precise disclosure obligation depends upon the statutory requirements, the nature of the information, and applicable exemptions.

4. Important Supreme Court Judgments and Their Legal Principles

Case 1: E.P. Royappa v. State of Tamil Nadu

Citation: (1974) 4 SCC 3

Legal issue: Whether arbitrary State action is inconsistent with the constitutional guarantee of equality under Article 14.

Judgment and principle:

The Supreme Court developed the principle that equality and arbitrariness are fundamentally opposed to each other.

The Court recognised that arbitrary State action is incompatible with Article 14.

Relevance to non-publication of benchmark methodology:

Where an authority formulates or applies a benchmark without objective standards, transparency, or rational justification, the decision may become vulnerable to challenge under Article 14.

For instance, if an institution introduces undisclosed performance parameters and uses them to rank different organisations, the affected organisations may question whether the methodology is based on objective and rational considerations.

Legal proposition: Administrative discretion cannot be exercised arbitrarily or according to the unfettered choice of the decision-making authority.

Case 2: Maneka Gandhi v. Union of India

Citation: (1978) 1 SCC 248

Legal issue: Whether administrative and governmental procedures affecting individual rights must satisfy standards of fairness and reasonableness.

Judgment and principle:

The Supreme Court significantly expanded the understanding of procedural fairness under Article 21.

The Court held that the procedure contemplated by law must be fair, just, and reasonable rather than arbitrary, fanciful, or oppressive.

Relevance:

Where an undisclosed benchmark methodology affects an individual's rights, professional opportunities, or other legally protected interests, the fairness of the procedure may become relevant.

An authority should not adopt a procedure that makes it practically impossible for an affected person to understand or meaningfully challenge an adverse decision.

Legal proposition: Administrative procedures affecting rights must satisfy the applicable standards of fairness and reasonableness.

Case 3: Tata Cellular v. Union of India

Citation: (1994) 6 SCC 651

Important judgment on transparency in evaluation

Legal issue: Whether governmental tendering and evaluation decisions are subject to judicial review.

Judgment and principle:

The Supreme Court explained that governmental contractual decisions are subject to judicial review to prevent arbitrariness, favouritism, and improper exercise of discretion.

The Court emphasised that judicial review primarily examines the decision-making process rather than substituting the court's own commercial or administrative assessment.

The judgment also considered the issue of evolving evaluation criteria.

Relevance to benchmark methodology:

This judgment is important where an authority uses evaluation parameters or benchmarking standards to assess competing applicants, bidders, or institutions.

It supports the proposition that evaluation processes must comply with Article 14 and cannot be manipulated for collateral purposes.

However, the judgment does not establish that every criterion not expressly disclosed in advance is automatically unlawful. Its treatment of the particular hidden-criteria issue depended on the facts and circumstances of that case.

Legal proposition: Evaluation discretion is permissible, but its exercise must remain fair, rational, and free from arbitrariness or favouritism.

Case 4: S.N. Mukherjee v. Union of India

Citation: (1990) 4 SCC 594

Legal issue: Whether administrative and quasi-judicial authorities are required to record reasons for their decisions.

Judgment and principle:

The Supreme Court recognised the importance of recording reasons in administrative and quasi-judicial decision-making.

Reasons help demonstrate that the authority has applied its mind and enable the affected person to understand the basis of the decision.

Relevance to benchmark methodology:

If an authority uses an undisclosed methodology and subsequently refuses to explain how the benchmark was calculated, it becomes difficult to determine whether the decision was rational.

An affected person may seek:

The basis for selecting the benchmark.

The reasons for adopting particular parameters.

The justification for assigning specific weightages.

The reasons for accepting or rejecting relevant data.

The reasoning behind the final assessment.

Legal proposition: Reasoned decision-making is an important safeguard against arbitrary administrative action.

Case 5: Kranti Associates Pvt. Ltd. v. Masood Ahmed Khan

Citation: (2010) 9 SCC 496

Legal issue: Importance of recording reasons in judicial, quasi-judicial, and administrative decisions.

Judgment and principle:

The Supreme Court explained that recording reasons promotes transparency, accountability, fairness, and public confidence in decision-making.

Reasons help prevent arbitrary exercise of power and facilitate judicial review.

Relevance to benchmark methodology:

Suppose an authority publishes a final benchmark score but does not explain:

Why a particular indicator was selected.

Why one parameter received greater weightage.

How the data was assessed.

Why a particular formula was adopted.

How the final score was calculated.

Such a decision may be difficult to scrutinise meaningfully.

The judgment supports the importance of explaining the reasoning behind administrative decisions.

Legal proposition: Reasoned decisions are an important component of transparent and accountable administration.

Case 6: Uflex Ltd. v. Government of Tamil Nadu

Citation: (2022) 1 SCC 165

Legal issue: Transparency and judicial review in government tendering processes.

Judgment and principle:

The Supreme Court recognised that transparency is necessary in government tender processes because of the nature of economic activity undertaken by the State.

At the same time, it emphasised that judicial review has limitations and courts should not unnecessarily substitute their commercial judgment for that of the competent authority.

Relevance:

Where a public authority evaluates competing entities using technical benchmarks, financial criteria, or scoring mechanisms, the process must satisfy applicable standards of transparency and fairness.

The authority has administrative discretion, but that discretion cannot be exercised arbitrarily.

Legal proposition: Transparency in public evaluation processes is essential, while judicial interference remains governed by established principles of judicial review.

Case 7: Michigan Rubber (India) Ltd. v. State of Karnataka

Citation: (2012) 8 SCC 216

Legal issue: Whether the terms and conditions of government tenders can be challenged as arbitrary or unreasonable.

Judgment and principle:

The Supreme Court recognised that the State has considerable freedom in framing tender conditions.

However, the authority's actions remain subject to Article 14.

The Court explained that judicial interference may be justified where the process is mala fide, intended to favour someone, or so arbitrary and irrational that no reasonable authority could have adopted it.

Relevance:

An undisclosed benchmark methodology may raise questions about:

Unequal treatment.

Unreasonable evaluation standards.

Selective application of criteria.

Unexplained changes in scoring.

Preferential treatment of certain participants.

Legal proposition: Administrative and contractual discretion is not unlimited and remains subject to constitutional standards of fairness and non-arbitrariness.

Case 8: CPIO, Supreme Court of India v. Subhash Chandra Agarwal

Citation: (2020) 5 SCC 481

Legal issue: Transparency, disclosure, and the right to information under the RTI Act.

Judgment and principle:

The Supreme Court examined the relationship between transparency and the protection of information under the RTI framework.

The judgment recognised the importance of transparency in public administration while also considering privacy, confidentiality, and the applicable statutory exemptions.

Relevance:

Where benchmark methodology is maintained by a public authority, the RTI Act may provide a route to seek the underlying records.

The authority must consider the request in accordance with the statutory disclosure requirements and applicable exemptions.

Legal proposition: Transparency is an important objective of the RTI framework, but disclosure must be balanced against legally recognised exemptions.

5. Legal Consequences of Failure to Publish Benchmark Methodology

Failure to disclose the methodology may give rise to the following legal consequences, depending on the nature of the authority and the impact of its decision.

5.1 Violation of Article 14

Where the methodology is undisclosed and is applied arbitrarily, inconsistently, or selectively, the decision may be challenged as violative of Article 14.

The affected person may argue that the authority has failed to establish objective standards governing its decision.

5.2 Violation of Principles of Natural Justice

If the benchmark determines an adverse outcome without providing sufficient information about the assessment, an affected person may contend that a meaningful opportunity to make representations has been denied.

The argument becomes stronger where the authority relies on undisclosed material or criteria that the affected person could not reasonably anticipate.

5.3 Unreasonableness and Non-Application of Mind

Where no reasons are supplied for adopting a particular methodology, the authority may face questions concerning:

The rationality of the benchmark.

The relevance of the selected parameters.

The reliability of the underlying data.

The justification for the assigned weightage.

The consistency of its application.

5.4 Possibility of Judicial Review

An affected person may approach the appropriate High Court under Article 226 of the Constitution or, where legally available, invoke other statutory remedies.

The court may examine whether the authority acted within its legal powers and followed a fair, reasonable, and non-arbitrary procedure.

Depending on the facts, possible reliefs include:

Setting aside an arbitrary decision.

Directing the authority to disclose relevant methodology and records.

Requiring reconsideration through objective criteria.

Directing a fresh evaluation.

Requiring the authority to provide reasons.

Granting other appropriate consequential relief.

However, a court will not necessarily invalidate a decision merely because the methodology was not published. The legal consequences depend on the governing statute, applicable rules, legitimate confidentiality interests, and whether the omission resulted in material unfairness or illegality.

6. Difference Between Non-Disclosure of Methodology and Non-Disclosure of Final Results

These are two distinct issues.

Non-disclosureLegal concern
Methodology not publishedLack of transparency in the assessment framework
Evaluation criteria not disclosedPotential unpredictability and unequal treatment
Weightage not disclosedInability to understand the relative importance of parameters
Formula not disclosedDifficulty verifying calculations
Data sources not disclosedQuestions regarding reliability and authenticity
Reasons not disclosedLack of accountability and difficulty in judicial review
Final results not publishedLack of access to the outcome of the assessment

An authority may publish the final results while withholding the methodology. This does not necessarily satisfy all applicable transparency obligations.

Similarly, publication of the methodology alone does not guarantee fairness if the authority subsequently departs from it without justification.

7. What Should a Transparent Benchmark Methodology Contain?

A properly documented methodology should ordinarily address the following matters:

ComponentInformation requiring explanation
ObjectivePurpose for establishing the benchmark
ParametersIndicators used for assessment
WeightageRelative importance of each indicator
FormulaMathematical or statistical calculation
DataSources and collection methods
ValidationVerification of data accuracy
Reference periodPeriod covered by the assessment
NormalisationMethod of making different datasets comparable
ExceptionsTreatment of unusual circumstances
ReviewMechanism for objections and corrections
ApprovalCompetent authority approving the methodology
RevisionProcedure for changing the benchmark

This documentation makes the process more predictable, reproducible, and accountable.

8. Legal Arguments That Can Be Raised Against an Undisclosed Benchmark Methodology

An affected person or institution may formulate the following grounds, where supported by evidence:

Ground I – Arbitrary exercise of administrative power

The authority has adopted and applied a benchmark without adequately disclosing the objective criteria governing its formulation and application. Such action raises concerns under Article 14 of the Constitution.

Ground II – Absence of transparency

The methodology, parameters, weightage, and calculation mechanism have not been adequately disclosed, thereby preventing affected persons from understanding the basis of the assessment.

Ground III – Violation of procedural fairness

The affected persons have not been provided with sufficient information to make meaningful representations concerning the benchmark or its application.

Ground IV – Absence of reasoned decision-making

The authority has communicated the outcome without adequately explaining the reasoning, calculations, or relevant considerations underlying its decision.

Ground V – Possibility of inconsistent application

In the absence of a disclosed and consistently applied methodology, it becomes difficult to verify whether similarly situated persons or institutions have been evaluated using the same standards.

Ground VI – Hindrance to judicial review

Non-disclosure of the relevant methodology and supporting records may obstruct effective scrutiny of whether the authority has exercised its powers lawfully and reasonably.

9. Important Legal Distinction: Is Publication of Every Benchmark Methodology Mandatory?

This is an important distinction when formulating a legal challenge.

There is no universal constitutional rule requiring every private or public organisation to publish every technical, statistical, or internal benchmarking methodology.

The obligation depends upon:

Whether the organisation is a State authority or public authority.

Whether a particular statute, regulation, government policy, or contractual provision requires publication.

Whether the benchmark affects legally protected rights or public benefits.

Whether the methodology forms part of a public selection, procurement, regulatory, or assessment process.

Whether confidentiality, intellectual property, privacy, or other legitimate exemptions apply.

For government tendering, for example, the disclosure of evaluation criteria in advance is particularly important. In other administrative contexts, disclosure of reasons and relevant records may be more important than universal publication of every technical detail.

Therefore, the strongest legal challenge is not simply that the methodology was not published, but that the failure to disclose it violated an applicable legal obligation or rendered the resulting decision arbitrary, unfair, unreasonable, or incapable of meaningful scrutiny.

10. Suggested Legal Precedent Table

Supreme Court judgmentCitationPrinciple relevant to the issue
E.P. Royappa v. State of Tamil Nadu(1974) 4 SCC 3Arbitrariness is opposed to equality
Maneka Gandhi v. Union of India(1978) 1 SCC 248Fair and reasonable procedure
S.N. Mukherjee v. Union of India(1990) 4 SCC 594Recording reasons in administrative decisions
Tata Cellular v. Union of India(1994) 6 SCC 651Judicial review and fairness in government evaluation
Kranti Associates v. Masood Ahmed Khan(2010) 9 SCC 496Transparency, accountability, and reasoned decisions
Michigan Rubber v. State of Karnataka(2012) 8 SCC 216Non-arbitrariness in tender conditions
Uflex Ltd. v. Government of Tamil Nadu(2022) 1 SCC 165Transparency in government tender processes
CPIO, Supreme Court of India v. Subhash Chandra Agarwal(2020) 5 SCC 481Transparency and disclosure under RTI

11. Conclusion

Failure to publish benchmark methodology transparently is not merely an administrative deficiency. In appropriate circumstances, it can raise substantial questions of constitutional legality, procedural fairness, institutional accountability, and administrative transparency.

Where a public authority uses a benchmark to determine the eligibility, ranking, selection, performance, financial entitlement, or other interests of affected persons, it must be able to demonstrate that the underlying process is lawful, rational, objective, and consistently applied.

The principles laid down in E.P. Royappa, Maneka Gandhi, Tata Cellular, S.N. Mukherjee, and Kranti Associates provide an important judicial foundation for examining such decisions.

The fundamental legal position can be expressed as follows:

An authority exercising public power cannot justify an adverse decision merely by publishing its final benchmark or assessment result while withholding the essential basis on which that result was determined, where such disclosure is legally required or necessary to ensure fairness and prevent arbitrariness. The methodology, evaluation parameters, and reasons must be sufficiently transparent to permit meaningful scrutiny of the legality and rationality of the decision.

12. Suggested Paragraph for a Legal Representation or Writ Petition

Writing

 

Failure to Publish Benchmark Methodology in a Transparent and Reasoned Manner

That the failure of the Respondent Authority to publish and disclose the benchmark methodology, including the underlying parameters, evaluation criteria, weightage, calculation formula, data sources, and relevant assessment standards, raises serious concerns regarding transparency, fairness, and accountability in the decision-making process. The adoption and application of an undisclosed or inadequately explained methodology, particularly where it has a direct bearing on the rights, interests, eligibility, ranking, or entitlements of affected persons, may render the resulting decision arbitrary, unreasonable, and susceptible to judicial scrutiny under Article 14 of the Constitution of India.

That the Respondent Authority is required to exercise its administrative discretion in accordance with established principles of fairness, reasonableness, non-arbitrariness, and procedural propriety. The principles enunciated by the Hon'ble Supreme Court in E.P. Royappa v. State of Tamil Nadu, (1974) 4 SCC 3; Maneka Gandhi v. Union of India, (1978) 1 SCC 248; Tata Cellular v. Union of India, (1994) 6 SCC 651; S.N. Mukherjee v. Union of India, (1990) 4 SCC 594; and Kranti Associates Pvt. Ltd. v. Masood Ahmed Khan, (2010) 9 SCC 496, reinforce the requirement that administrative decisions must satisfy applicable standards of fairness, rationality, and reasoned decision-making.

That the non-disclosure of the methodology prevents affected persons from independently understanding, verifying, and effectively challenging the basis of the assessment. It also raises concerns regarding the uniform application of evaluation standards and the possibility of inconsistent or arbitrary treatment. Accordingly, the Respondent Authority ought to disclose the relevant benchmark methodology and supporting records, subject to applicable statutory exemptions and legitimate confidentiality requirements, and provide a reasoned explanation of the decision taken on its basis.

That the Petitioner therefore seeks appropriate directions requiring the Respondent Authority to disclose the approved benchmark methodology, underlying evaluation parameters, assigned weightage, calculation mechanism, relevant data sources, and reasons supporting the assessment, and to reconsider the impugned decision in accordance with law if the examination reveals procedural irregularity, arbitrariness, or violation of applicable legal requirements.

Important: This is an India-focused general legal analysis. The precise legal position will depend on the type of benchmark involved—for example, government procurement, institutional ranking, recruitment, regulatory assessment, accreditation, or financial benchmarking. The applicable statutory framework may materially change the legal grounds.

LawGratis provides pro bono legal aid and resources to empower communities. Join us in making justice reachable for everyone! Follow our community on Instagram, YouTube, Facebook, and LinkedIn.

LEAVE A COMMENT