Skip to content

[DXIL] Add support for root signature flag element in DXContainer #123147

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 72 commits into from
Feb 13, 2025
Merged
Show file tree
Hide file tree
Changes from 53 commits
Commits
Show all changes
72 commits
Select commit Hold shift + click to select a range
8adb678
adding rootsignature to obj2yaml
Jan 13, 2025
ba78f21
adding test
Jan 13, 2025
0a54559
removing old test
Jan 13, 2025
557075f
remove useless includes
Jan 13, 2025
e0d3dcd
addressing comments
Jan 14, 2025
80587dd
updating test
Jan 14, 2025
be3764d
removing useless header
Jan 15, 2025
7582ca6
fix formating
Jan 15, 2025
6aaa0a5
renaming test
Jan 15, 2025
916b2f1
addressing pr comments
Jan 16, 2025
d9bce0a
adding str to ROOT_ELEMENT_FLAG
Jan 16, 2025
e7676ed
formating
Jan 17, 2025
a0cee57
refactoring to follow llvm standards
Jan 18, 2025
1e7a1fe
addressing comments
Jan 27, 2025
0ed658a
clean up
Jan 27, 2025
932062e
remove version
Jan 30, 2025
628937c
fix pr
Jan 30, 2025
1378c9f
adding dxil-dis test
Jan 31, 2025
e3206c9
adding compatibility test
Jan 31, 2025
f93d42d
addressing test concerns
Feb 3, 2025
25e3f37
clean up
Feb 3, 2025
751cbdc
addressing comments
Feb 4, 2025
44532d6
adding fail test
Feb 4, 2025
ca21878
adding comment
Feb 4, 2025
987901c
adding few more tests
Feb 4, 2025
0fbe900
format
Feb 4, 2025
b771aea
cleanup
Feb 5, 2025
aabdfe7
adding metadata extraction
Jan 15, 2025
4f6f941
moving root signature to it's own pass
Jan 16, 2025
a7f7784
formating
Jan 16, 2025
bf3b2e0
removing useless imports
Jan 16, 2025
16b4d03
fixing pr changes
Jan 16, 2025
e043370
adding some asserts
Jan 16, 2025
57bf935
format
Jan 16, 2025
1f8c0a5
fixing assert
Jan 18, 2025
0905b83
cleaning
Jan 27, 2025
77e8544
clean up
Jan 29, 2025
1351fb0
addressing comments
Jan 30, 2025
09e645a
removing version
Jan 30, 2025
5a44b62
fix test
Jan 30, 2025
d1a79b3
addressing PR Comments
Jan 31, 2025
9f8e512
fix test
Feb 3, 2025
5c7ed7e
filtering root signatures not associated with entry function
Feb 4, 2025
93f7c4c
separating parsing and validation
Feb 4, 2025
5aac761
improve error handling
Feb 6, 2025
47b01f7
clean up
Feb 6, 2025
486ab88
clean up
Feb 6, 2025
852ac25
formating
Feb 6, 2025
74f7226
addressing comments and fix tests
Feb 7, 2025
7a82fa9
fixing tests
Feb 7, 2025
c67d039
formating
Feb 7, 2025
e80ef33
Merge branch 'main' into users/joaosaffran/123147
Feb 7, 2025
ef1ce8a
fix
Feb 7, 2025
b7f2716
Merge branch 'main' into users/joaosaffran/123147
Feb 10, 2025
83b0979
addressing pr comments
Feb 10, 2025
b175b65
addressing PR comments
Feb 11, 2025
01b49a7
addressing pr comments
Feb 11, 2025
7bba9d3
removing copies from root signature use in dx container globals
Feb 11, 2025
2809c2f
adding more tests
Feb 12, 2025
023dcb8
maybe fix test?
Feb 12, 2025
aedb446
fixing clang format
Feb 12, 2025
39e60c0
try fix format
Feb 12, 2025
3b135c6
removing test
Feb 12, 2025
ae3d03f
adding llvm unreachable and testing test
Feb 12, 2025
3d19f8b
stopping compilation if root signature error were emitted
Feb 12, 2025
5a3be7c
making sure Error tests fail
Feb 12, 2025
f64c608
refactoring root signature analysis to return a map instead
Feb 12, 2025
a5a2093
addressing pr comments
Feb 12, 2025
5b3fedc
clean up
Feb 12, 2025
605f225
addressing pr comments
Feb 13, 2025
e4bca2b
implementing find interface for RootSignatureAnalysisWrapper
Feb 13, 2025
825673f
adding test for null function
Feb 13, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 4 additions & 12 deletions llvm/include/llvm/BinaryFormat/DXContainer.h
Original file line number Diff line number Diff line change
Expand Up @@ -14,8 +14,6 @@
#define LLVM_BINARYFORMAT_DXCONTAINER_H

#include "llvm/ADT/StringRef.h"
#include "llvm/Support/BinaryStreamError.h"
#include "llvm/Support/Error.h"
#include "llvm/Support/SwapByteOrder.h"
#include "llvm/TargetParser/Triple.h"

Expand Down Expand Up @@ -550,18 +548,12 @@ static_assert(sizeof(ProgramSignatureElement) == 32,

struct RootSignatureValidations {

static Expected<uint32_t> validateRootFlag(uint32_t Flags) {
if ((Flags & ~0x80000fff) != 0)
return llvm::make_error<BinaryStreamError>("Invalid Root Signature flag");
return Flags;
static bool validateRootFlag(uint32_t Flags) {
return (Flags & ~0x80000fff) != 0;
}

static Expected<uint32_t> validateVersion(uint32_t Version) {
if (Version == 1 || Version == 2)
return Version;

return llvm::make_error<BinaryStreamError>(
"Invalid Root Signature Version");
static bool validateVersion(uint32_t Version) {
return !(Version == 1 || Version == 2);
}
};

Expand Down
18 changes: 7 additions & 11 deletions llvm/lib/Object/DXContainer.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -9,9 +9,9 @@
#include "llvm/Object/DXContainer.h"
#include "llvm/BinaryFormat/DXContainer.h"
#include "llvm/Object/Error.h"
#include "llvm/Support/FormatVariadic.h"
#include "llvm/Support/Alignment.h"
#include "llvm/Support/Endian.h"
#include "llvm/Support/FormatVariadic.h"

using namespace llvm;
using namespace llvm::object;
Expand Down Expand Up @@ -254,11 +254,9 @@ Error DirectX::RootSignature::parse(StringRef Data) {
support::endian::read<uint32_t, llvm::endianness::little>(Current);
Current += sizeof(uint32_t);

Expected<uint32_t> MaybeVersion =
dxbc::RootSignatureValidations::validateVersion(VValue);
if (Error E = MaybeVersion.takeError())
return E;
Version = MaybeVersion.get();
if (dxbc::RootSignatureValidations::validateVersion(VValue))
return make_error<GenericBinaryError>("Invalid Root Signature Version");
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These error strings are what get printed by LLVM if we ever hit this error condition. This message doesn't tell me what the actual error is.

Maybe something like (needs proper formatting):

Suggested change
return make_error<GenericBinaryError>("Invalid Root Signature Version");
return make_error<GenericBinaryError>(Twine("Unsupported root signature version read: " + VValue);

Version = VValue;

NumParameters =
support::endian::read<uint32_t, llvm::endianness::little>(Current);
Expand All @@ -280,11 +278,9 @@ Error DirectX::RootSignature::parse(StringRef Data) {
support::endian::read<uint32_t, llvm::endianness::little>(Current);
Current += sizeof(uint32_t);

Expected<uint32_t> MaybeFlag =
dxbc::RootSignatureValidations::validateRootFlag(FValue);
if (Error E = MaybeFlag.takeError())
return E;
Flags = MaybeFlag.get();
if (dxbc::RootSignatureValidations::validateRootFlag(FValue))
return make_error<GenericBinaryError>("Invalid Root Signature flag");
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same feedback as above, we can make this a useful error.

Flags = FValue;

return Error::success();
}
Expand Down
2 changes: 1 addition & 1 deletion llvm/lib/Target/DirectX/CMakeLists.txt
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@ add_llvm_target(DirectXCodeGen
DXILResourceAccess.cpp
DXILShaderFlags.cpp
DXILTranslateMetadata.cpp

DXILRootSignature.cpp
LINK_COMPONENTS
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please keep the blank line between the sources and the LINK_COMPONENTS line - it makes this easier to read.

Analysis
AsmPrinter
Expand Down
28 changes: 28 additions & 0 deletions llvm/lib/Target/DirectX/DXContainerGlobals.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,7 @@
//
//===----------------------------------------------------------------------===//

#include "DXILRootSignature.h"
#include "DXILShaderFlags.h"
#include "DirectX.h"
#include "llvm/ADT/SmallVector.h"
Expand All @@ -23,6 +24,7 @@
#include "llvm/IR/Module.h"
#include "llvm/InitializePasses.h"
#include "llvm/MC/DXContainerPSVInfo.h"
#include "llvm/MC/DXContainerRootSignature.h"
#include "llvm/Pass.h"
#include "llvm/Support/MD5.h"
#include "llvm/Transforms/Utils/ModuleUtils.h"
Expand All @@ -41,6 +43,7 @@ class DXContainerGlobals : public llvm::ModulePass {
GlobalVariable *buildSignature(Module &M, Signature &Sig, StringRef Name,
StringRef SectionName);
void addSignature(Module &M, SmallVector<GlobalValue *> &Globals);
void addRootSignature(Module &M, SmallVector<GlobalValue *> &Globals);
void addResourcesForPSV(Module &M, PSVRuntimeInfo &PSV);
void addPipelineStateValidationInfo(Module &M,
SmallVector<GlobalValue *> &Globals);
Expand All @@ -60,6 +63,7 @@ class DXContainerGlobals : public llvm::ModulePass {
void getAnalysisUsage(AnalysisUsage &AU) const override {
AU.setPreservesAll();
AU.addRequired<ShaderFlagsAnalysisWrapper>();
AU.addRequired<RootSignatureAnalysisWrapper>();
AU.addRequired<DXILMetadataAnalysisWrapperPass>();
AU.addRequired<DXILResourceTypeWrapperPass>();
AU.addRequired<DXILResourceBindingWrapperPass>();
Expand All @@ -73,6 +77,7 @@ bool DXContainerGlobals::runOnModule(Module &M) {
Globals.push_back(getFeatureFlags(M));
Globals.push_back(computeShaderHash(M));
addSignature(M, Globals);
addRootSignature(M, Globals);
addPipelineStateValidationInfo(M, Globals);
appendToCompilerUsed(M, Globals);
return true;
Expand Down Expand Up @@ -144,6 +149,29 @@ void DXContainerGlobals::addSignature(Module &M,
Globals.emplace_back(buildSignature(M, OutputSig, "dx.osg1", "OSG1"));
}

void DXContainerGlobals::addRootSignature(Module &M,
SmallVector<GlobalValue *> &Globals) {

auto &RSA = getAnalysis<RootSignatureAnalysisWrapper>();

if (!RSA.hasRootSignature())
return;

ModuleRootSignature MRS = RSA.getRootSignature();

SmallString<256> Data;
raw_svector_ostream OS(Data);

RootSignatureHeader RSH;
RSH.Flags = MRS.Flags;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why do we have an auxilliary structure that we simply copy through here? Could RootSignatureAnalysis just provide us with a RootSignatureHeader directly? Is ModuleRootSignature going to grow into something that just duplicates RootSignatureHeader's fields?

aside: Both ModuleRootSignature and RootSignatureHeader feel kind of poorly named - ModuleRootSignature has nothing to do with the module AFAICT, and RootSignatureHeader is the object that derives the whole root signature, not just the header....


RSH.write(OS);

Constant *Constant =
ConstantDataArray::getString(M.getContext(), Data, /*AddNull*/ false);
Globals.emplace_back(buildContainerGlobal(M, Constant, "dx.rts0", "RTS0"));
}

void DXContainerGlobals::addResourcesForPSV(Module &M, PSVRuntimeInfo &PSV) {
const DXILBindingMap &DBM =
getAnalysis<DXILResourceBindingWrapperPass>().getBindingMap();
Expand Down
196 changes: 196 additions & 0 deletions llvm/lib/Target/DirectX/DXILRootSignature.cpp
Original file line number Diff line number Diff line change
@@ -0,0 +1,196 @@
//===- DXILRootSignature.cpp - DXIL Root Signature helper objects ----===//
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think I counted this right

Suggested change
//===- DXILRootSignature.cpp - DXIL Root Signature helper objects ----===//
//===- DXILRootSignature.cpp - DXIL Root Signature helper objects -------===//

//
// Part of the LLVM Project, under the Apache License v2.0 with LLVM Exceptions.
// See https://llvm.org/LICENSE.txt for license information.
// SPDX-License-Identifier: Apache-2.0 WITH LLVM-exception
//
//===----------------------------------------------------------------------===//
///
/// \file This file contains helper objects and APIs for working with DXIL
/// Root Signatures.
///
//===----------------------------------------------------------------------===//
#include "DXILRootSignature.h"
#include "DirectX.h"
#include "llvm/ADT/StringSwitch.h"
#include "llvm/ADT/Twine.h"
#include "llvm/Analysis/DXILMetadataAnalysis.h"
#include "llvm/BinaryFormat/DXContainer.h"
#include "llvm/IR/Constants.h"
#include "llvm/IR/DiagnosticInfo.h"
#include "llvm/IR/Function.h"
#include "llvm/IR/LLVMContext.h"
#include "llvm/IR/Module.h"
#include "llvm/InitializePasses.h"
#include "llvm/Pass.h"
#include "llvm/Support/Error.h"
#include <optional>

using namespace llvm;
using namespace llvm::dxil;

bool ModuleRootSignature::reportError(Twine Message,
DiagnosticSeverity Severity) {
Ctx->diagnose(DiagnosticInfoGeneric(Message, Severity));
return true;
}

bool ModuleRootSignature::parseRootFlags(MDNode *RootFlagNode) {

if (RootFlagNode->getNumOperands() != 2)
return reportError("Invalid format for RootFlag Element");

auto *Flag = mdconst::extract<ConstantInt>(RootFlagNode->getOperand(1));
this->Flags = Flag->getZExtValue();

return false;
}

bool ModuleRootSignature::parseRootSignatureElement(MDNode *Element) {
MDString *ElementText = cast<MDString>(Element->getOperand(0));
if (ElementText == nullptr)
return reportError("Invalid format for Root Element");

RootSignatureElementKind ElementKind =
StringSwitch<RootSignatureElementKind>(ElementText->getString())
.Case("RootFlags", RootSignatureElementKind::RootFlags)
.Case("RootConstants", RootSignatureElementKind::RootConstants)
.Case("RootCBV", RootSignatureElementKind::RootDescriptor)
.Case("RootSRV", RootSignatureElementKind::RootDescriptor)
.Case("RootUAV", RootSignatureElementKind::RootDescriptor)
.Case("Sampler", RootSignatureElementKind::RootDescriptor)
.Case("DescriptorTable", RootSignatureElementKind::DescriptorTable)
.Case("StaticSampler", RootSignatureElementKind::StaticSampler)
.Default(RootSignatureElementKind::None);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should RootSignatureElementKind::None actually be called RootSignatureElementKind::Error? The current name makes me think there is simply no root signature, but the way it's used seems to generally be "the root signature is invalid"


switch (ElementKind) {

case RootSignatureElementKind::RootFlags: {
return parseRootFlags(Element);
break;
}

case RootSignatureElementKind::RootConstants:
case RootSignatureElementKind::RootDescriptor:
case RootSignatureElementKind::DescriptorTable:
case RootSignatureElementKind::StaticSampler:
case RootSignatureElementKind::None:
return reportError("Invalid Root Element: " + ElementText->getString());
break;
}

return true;
}

bool ModuleRootSignature::parse(NamedMDNode *Root, const Function *EF) {
bool HasError = false;

/** Root Signature are specified as following in the metadata:

!dx.rootsignatures = !{!2} ; list of function/root signature pairs
!2 = !{ ptr @main, !3 } ; function, root signature
!3 = !{ !4, !5, !6, !7 } ; list of root signature elements

So for each MDNode inside dx.rootsignatures NamedMDNode
(the Root parameter of this function), the parsing process needs
to loop through each of it's operand and process the pairs function
signature pair.
*/

for (const MDNode *Node : Root->operands()) {
if (Node->getNumOperands() != 2)
return reportError("Invalid format for Root Signature Definition. Pairs "
"of function, root signature expected.");

ValueAsMetadata *VAM =
llvm::dyn_cast<ValueAsMetadata>(Node->getOperand(0).get());
if (VAM == nullptr)
return reportError("First element of root signature is not a value");

Function *F = dyn_cast<Function>(VAM->getValue());
if (F == nullptr)
return reportError("First element of root signature is not a function");

if (F != EF)
continue;

// Get the Root Signature Description from the function signature pair.
MDNode *RS = dyn_cast<MDNode>(Node->getOperand(1).get());

if (RS == nullptr)
return reportError("Missing Root Element List Metadata node.");

// Loop through the Root Elements of the root signature.
for (unsigned int Eid = 0; Eid < RS->getNumOperands(); Eid++) {
MDNode *Element = dyn_cast<MDNode>(RS->getOperand(Eid));
if (Element == nullptr)
return reportError("Missing Root Element Metadata Node.");

HasError = HasError || parseRootSignatureElement(Element);
}
}
return HasError;
}

bool ModuleRootSignature::validate() {
if (dxbc::RootSignatureValidations::validateRootFlag(Flags)) {
return reportError("Invalid Root Signature flag value");
}
return false;
}

OptionalRootSignature ModuleRootSignature::analyzeModule(Module &M,
const Function *F) {
ModuleRootSignature MRS(&M.getContext());

NamedMDNode *RootSignatureNode = M.getNamedMetadata("dx.rootsignatures");
if (RootSignatureNode == nullptr || MRS.parse(RootSignatureNode, F) ||
MRS.validate())
return std::nullopt;

return MRS;
}

AnalysisKey RootSignatureAnalysis::Key;

OptionalRootSignature RootSignatureAnalysis::run(Module &M,
ModuleAnalysisManager &AM) {
auto MMI = AM.getResult<DXILMetadataAnalysis>(M);

if (MMI.ShaderProfile == Triple::Library)
return std::nullopt;

assert(MMI.EntryPropertyVec.size() == 1);

const Function *EntryFunction = MMI.EntryPropertyVec[0].Entry;
return ModuleRootSignature::analyzeModule(M, EntryFunction);
}

//===----------------------------------------------------------------------===//
bool RootSignatureAnalysisWrapper::runOnModule(Module &M) {

dxil::ModuleMetadataInfo &MMI =
getAnalysis<DXILMetadataAnalysisWrapperPass>().getModuleMetadata();

if (MMI.ShaderProfile == Triple::Library)
return false;
assert(MMI.EntryPropertyVec.size() == 1);

const Function *EntryFunction = MMI.EntryPropertyVec[0].Entry;
MRS = ModuleRootSignature::analyzeModule(M, EntryFunction);
return false;
}

void RootSignatureAnalysisWrapper::getAnalysisUsage(AnalysisUsage &AU) const {
AU.setPreservesAll();
AU.addRequired<DXILMetadataAnalysisWrapperPass>();
}

char RootSignatureAnalysisWrapper::ID = 0;

INITIALIZE_PASS_BEGIN(RootSignatureAnalysisWrapper,
"dx-root-signature-analysis",
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This should be called dxil-root-signature-analysis. The dx- prefix seems to be used in DXILShaderFlags for some reason, but generally we've been consistent with the dxil- prefix.

"DXIL Root Signature Analysis", true, true)
INITIALIZE_PASS_DEPENDENCY(DXILMetadataAnalysisWrapperPass)
INITIALIZE_PASS_END(RootSignatureAnalysisWrapper, "dx-root-signature-analysis",
"DXIL Root Signature Analysis", true, true)
Loading
Loading