Skip to content

EmitMLIR typo fix #1

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: emit-mlir
Choose a base branch
from
Open

Conversation

Moehre2
Copy link

@Moehre2 Moehre2 commented Aug 9, 2024

No description provided.

ivanradanov pushed a commit that referenced this pull request Oct 4, 2024
…ext is not fully initialized (llvm#110481)

As this comment around target initialization implies:
```
  // This can be NULL if we don't know anything about the architecture or if
  // the target for an architecture isn't enabled in the llvm/clang that we
  // built
```

There are cases where we might fail to call `InitBuiltinTypes` when
creating the backing `ASTContext` for a `TypeSystemClang`. If that
happens, the builtins `QualType`s, e.g., `VoidPtrTy`/`IntTy`/etc., are
not initialized and dereferencing them as we do in
`GetBuiltinTypeForEncodingAndBitSize` (and other places) will lead to
nullptr-dereferences. Example backtrace:
```
(lldb) run
Assertion failed: (!isNull() && "Cannot retrieve a NULL type pointer"), function getCommonPtr, file Type.h, line 958.
Process 2680 stopped
* thread llvm#15, name = '<lldb.process.internal-state(pid=2712)>', stop reason = hit program assert
    frame llvm#4: 0x000000010cdf3cdc liblldb.20.0.0git.dylib`DWARFASTParserClang::ExtractIntFromFormValue(lldb_private::CompilerType const&, lldb_private::plugin::dwarf::DWARFFormValue const&) const (.cold.1) + 
liblldb.20.0.0git.dylib`DWARFASTParserClang::ParseObjCMethod(lldb_private::ObjCLanguage::MethodName const&, lldb_private::plugin::dwarf::DWARFDIE const&, lldb_private::CompilerType, ParsedDWARFTypeAttributes
, bool) (.cold.1):
->  0x10cdf3cdc <+0>:  stp    x29, x30, [sp, #-0x10]!
    0x10cdf3ce0 <+4>:  mov    x29, sp
    0x10cdf3ce4 <+8>:  adrp   x0, 545
    0x10cdf3ce8 <+12>: add    x0, x0, #0xa25 ; "ParseObjCMethod"
Target 0: (lldb) stopped.
(lldb) bt
* thread llvm#15, name = '<lldb.process.internal-state(pid=2712)>', stop reason = hit program assert
    frame #0: 0x0000000180d08600 libsystem_kernel.dylib`__pthread_kill + 8
    frame #1: 0x0000000180d40f50 libsystem_pthread.dylib`pthread_kill + 288
    frame #2: 0x0000000180c4d908 libsystem_c.dylib`abort + 128
    frame llvm#3: 0x0000000180c4cc1c libsystem_c.dylib`__assert_rtn + 284
  * frame llvm#4: 0x000000010cdf3cdc liblldb.20.0.0git.dylib`DWARFASTParserClang::ExtractIntFromFormValue(lldb_private::CompilerType const&, lldb_private::plugin::dwarf::DWARFFormValue const&) const (.cold.1) + 
    frame llvm#5: 0x0000000109d30acc liblldb.20.0.0git.dylib`lldb_private::TypeSystemClang::GetBuiltinTypeForEncodingAndBitSize(lldb::Encoding, unsigned long) + 1188
    frame llvm#6: 0x0000000109aaaed4 liblldb.20.0.0git.dylib`DynamicLoaderMacOS::NotifyBreakpointHit(void*, lldb_private::StoppointCallbackContext*, unsigned long long, unsigned long long) + 384
```

This patch adds a one-time user-visible warning for when we fail to
initialize the AST to indicate that initialization went wrong for the
given target. Additionally, we add checks for whether one of the
`ASTContext` `QualType`s is invalid before dereferencing any builtin
types.

The warning would look as follows:
```
(lldb) target create "a.out"
Current executable set to 'a.out' (arm64).
(lldb) b main
warning: Failed to initialize builtin ASTContext types for target 'some-unknown-triple'. Printing variables may behave unexpectedly.
Breakpoint 1: where = a.out`main + 8 at stepping.cpp:5:14, address = 0x0000000100003f90
```

rdar://134869779
ivanradanov pushed a commit that referenced this pull request Nov 22, 2024
…onger cause a crash (llvm#116569)

This PR fixes a bug introduced by llvm#110199, which causes any half float
argument to crash the compiler on MIPS64.

Currently compiling this bit of code with `llc -mtriple=mips64`: 
```
define void @half_args(half %a) nounwind {
entry:
        ret void
}
```

Crashes with the following log:
```
LLVM ERROR: unable to allocate function argument #0
PLEASE submit a bug report to https://github.com/llvm/llvm-project/issues/ and include the crash backtrace.
Stack dump:
0.	Program arguments: llc -mtriple=mips64
1.	Running pass 'Function Pass Manager' on module '<stdin>'.
2.	Running pass 'MIPS DAG->DAG Pattern Instruction Selection' on function '@half_args'
 #0 0x000055a3a4013df8 llvm::sys::PrintStackTrace(llvm::raw_ostream&, int) (/home/davide/Ps2/rps2-tools/prefix/bin/llc+0x32d0df8)
 #1 0x000055a3a401199e llvm::sys::RunSignalHandlers() (/home/davide/Ps2/rps2-tools/prefix/bin/llc+0x32ce99e)
 #2 0x000055a3a40144a8 SignalHandler(int) Signals.cpp:0:0
 llvm#3 0x00007f00bde558c0 __restore_rt libc_sigaction.c:0:0
 llvm#4 0x00007f00bdea462c __pthread_kill_implementation ./nptl/pthread_kill.c:44:76
 llvm#5 0x00007f00bde55822 gsignal ./signal/../sysdeps/posix/raise.c:27:6
 llvm#6 0x00007f00bde3e4af abort ./stdlib/abort.c:81:7
 llvm#7 0x000055a3a3f80e3c llvm::report_fatal_error(llvm::Twine const&, bool) (/home/davide/Ps2/rps2-tools/prefix/bin/llc+0x323de3c)
 llvm#8 0x000055a3a2e20dfa (/home/davide/Ps2/rps2-tools/prefix/bin/llc+0x20dddfa)
 llvm#9 0x000055a3a2a34e20 llvm::MipsTargetLowering::LowerFormalArguments(llvm::SDValue, unsigned int, bool, llvm::SmallVectorImpl<llvm::ISD::InputArg> const&, llvm::SDLoc const&, llvm::SelectionDAG&, llvm::SmallVectorImpl<llvm::SDValue>&) const MipsISelLowering.cpp:0:0
llvm#10 0x000055a3a3d896a9 llvm::SelectionDAGISel::LowerArguments(llvm::Function const&) (/home/davide/Ps2/rps2-tools/prefix/bin/llc+0x30466a9)
llvm#11 0x000055a3a3e0b3ec llvm::SelectionDAGISel::SelectAllBasicBlocks(llvm::Function const&) (/home/davide/Ps2/rps2-tools/prefix/bin/llc+0x30c83ec)
llvm#12 0x000055a3a3e09e21 llvm::SelectionDAGISel::runOnMachineFunction(llvm::MachineFunction&) (/home/davide/Ps2/rps2-tools/prefix/bin/llc+0x30c6e21)
llvm#13 0x000055a3a2aae1ca llvm::MipsDAGToDAGISel::runOnMachineFunction(llvm::MachineFunction&) MipsISelDAGToDAG.cpp:0:0
llvm#14 0x000055a3a3e07706 llvm::SelectionDAGISelLegacy::runOnMachineFunction(llvm::MachineFunction&) (/home/davide/Ps2/rps2-tools/prefix/bin/llc+0x30c4706)
llvm#15 0x000055a3a3051ed6 llvm::MachineFunctionPass::runOnFunction(llvm::Function&) (/home/davide/Ps2/rps2-tools/prefix/bin/llc+0x230eed6)
llvm#16 0x000055a3a35a3ec9 llvm::FPPassManager::runOnFunction(llvm::Function&) (/home/davide/Ps2/rps2-tools/prefix/bin/llc+0x2860ec9)
llvm#17 0x000055a3a35ac3b2 llvm::FPPassManager::runOnModule(llvm::Module&) (/home/davide/Ps2/rps2-tools/prefix/bin/llc+0x28693b2)
llvm#18 0x000055a3a35a499c llvm::legacy::PassManagerImpl::run(llvm::Module&) (/home/davide/Ps2/rps2-tools/prefix/bin/llc+0x286199c)
llvm#19 0x000055a3a262abbb main (/home/davide/Ps2/rps2-tools/prefix/bin/llc+0x18e7bbb)
llvm#20 0x00007f00bde3fc4c __libc_start_call_main ./csu/../sysdeps/nptl/libc_start_call_main.h:74:3
llvm#21 0x00007f00bde3fd05 call_init ./csu/../csu/libc-start.c:128:20
llvm#22 0x00007f00bde3fd05 __libc_start_main@GLIBC_2.2.5 ./csu/../csu/libc-start.c:347:5
llvm#23 0x000055a3a2624921 _start /builddir/glibc-2.39/csu/../sysdeps/x86_64/start.S:117:0
```

This is caused by the fact that after the change, `f16`s are no longer
lowered as `f32`s in calls.

Two possible fixes are available:
- Update calling conventions to properly support passing `f16` as
integers.
- Update `useFPRegsForHalfType()` to return `true` so that `f16` are
still kept in `f32` registers, as before llvm#110199.

This PR implements the first solution to not introduce any more ABI
changes as llvm#110199 already did.

As of what is the correct ABI for halfs, I don't think there is a
correct answer. GCC doesn't support halfs on MIPS, and I couldn't find
any information on old MIPS ABI manuals either.
ivanradanov pushed a commit that referenced this pull request Nov 22, 2024
…lvm#116655)

This is the first part of the effort to make parsing of clause modifiers
more uniform and robust. Currently, when multiple modifiers are allowed,
the parser will expect them to appear in a hard-coded order.
Additionally, modifier properties (such as "ultimate") are checked
separately for each case.

The overall plan is
1. Extract all modifiers into their own top-level classes, and then
equip them with sets of common properties that will allow performing the
property checks generically, without refering to the specific kind of
the modifier.
2. Define a parser (as a separate class) for each modifier.
3. For each clause define a union (std::variant) of all allowable
modifiers, and parse the modifiers as a list of these unions.

The intent is also to isolate parts of the code that could eventually be
auto-generated.

OpenMP modifier overhaul: #1/3
ivanradanov pushed a commit that referenced this pull request Dec 15, 2024
input-gen tool

Generate inputs for all fucntions in module

Optionally compile the input gen module

Make rt optinal

Keep track of all available functions

add py script

Parallel input gen of single module

script

Fix scripts

Add test ll

Add initial recording capabilities

Merge fixes

clang-format

input-gen get module from stdin by default

binary output] of input

Move rt

Also output args

Add rt function for running the generated inputs

Add run instrumentation

Minor fixes

Move runtimes

Move runtimes

Fix

Load all remaps at once

Add dummy function

Add argument remapping, works for linked list example now

Remove printfs

Recognize library calls and don't stub them

Provide a first lit end to end test

Fix wrong function signature?

More robust scripts for large scale input gen

Remove stray variable

Precompile runtimes

add prefix and suffix to temp files

Dump to json

Rename script

Fix various little errors, add more tests

Properly support globals

Adjust insertion point

Fix type

Store the module for the mass_input script

Make it work with internal functions

Ensure to create the folder first

Add multicore mass input gen

Redo the mapping scheme to allow capture overwritten data

Return generated values from stubs

Fix minor oversight

remove broken assertion

Fix error w/ globals, add VERBOSE env var

Make free a noop during runs

Refactor input-gen tool

Fail in runtime instead of instrumentation for read_write kind

Also output module-wise statistics

chunksize=1

Keep track of functions in input-gen

Whole-module instrumentation

Fix rt-run compilation

Add function name to input binary file

Fix issues and tests

Test and fix run runtime

Fix mass-input-gen script

Use ray in mass input gen

Fix input-gen in shared library builds

Flux scripts

Fixes

Rename function

Switch tests to take cpp rts

Working ray impl

Add verbose mode

Update comments

Add enable.sh script

Move the "kind" from the function name to the signature

Bail early for addresses not to be instrumented

Also instrument readonly args

Add support for vectors

mass_input_gen: Log progress only every 500 modules

whoops

Add vector tests

Add support for structs and float

Fix enable script

Error in CreateGEP

Add verify option to input-gen

Change struct GEP index type to i32

Fix double read/write

Fix __inputgen__arg_* signature

Remove bitcode files

Print missing callback type

WIP support fp80, i128

Fix fp handling in input-gen

Add debug flag to input-gen

Fix target paths in tests

Fix remaining target paths in tests

Mark vector test XFAIL

Add support for running O1 before instrumentation (#1)

This patch adds support for running optimizations (specifically the O1
pipeline) before instrumentation. This will run passes like SROA which
might end up making instrumentation faster and is something that we want
to experiment with regardless.

WIP alternative object allocation scheme

WIP

WIP

WIP report

WIP various fixes

Ensure alignment

Dump aligned chunks

We do not need ValMap

We only need ptr offsets

Use uintptr_t * instead of void *

Comment out non working code

Add missing (void *)

WIP generate at least exists properly

WIP some fixes

Fix

Add debug flag to tests

Uncomment arg get for larger than ptr types

Fix store inst addr operand

Ptr tracking fix

Log addr translation

Handle input run struct args

Recursively handle struct args in input-run

Add nested struct test

Fix nested type handling

Add .gitignore

free

INPUTGEN_DEBUG macro

Make alignment functions more generic

Allocate memory chunks at the start

Extract object addressing logic

Input gen works

Fix input run

Pretty print stats

Fix stub value gen

Script improvements

Remove module ctors/dtors from instrumented module

Rename defined functions

Also -O0 when debugging is enabled in input-gen tool

More logging in mass_input_gen.py

Fix bugs in the script

Remove address translation

Ignore accesses to stack memory

Change default allocation

Add -DNDEBUG and O3 to mass input gen

Fix scripts

Fix Used array indexing issue

Use the INPUTGEN_DEBUG macro

Do not put code with side effects in assert..........

Improve logging in scripts

Silence unused var warnings

Properly load globals in rt-run

Make local run script more customizable

Fix memory issues

un-XFAIL vector-rw test

Use function ID in the filename instead of function name

Fix wrong printf types

Fix alignment and offset issues

Script fix

Do not litter cwd in tests

MIG script improvements

Silence compilation warnings

Need to print one more line

More robust script

Remove outdated comment

More descriptive name for stub gen value callbacks

Fail at runtime instead of at compile time when encountering unknown callback types

Strip comdat

Preserve landingpad globals

Only preserve allowed external functions

Use jug for parallelizing

Set up jug for mass input gen

Script fixes

Insert traps instead of unreachables

Script fixes

Remove unneeded prints

Script fix

Forgot to delete

Handle a case where stale files impacted the statistics

Internalize globals

Support masked load/store

Script fixes

Add useful commands to the readme

Small readme fix

Script fixes

Clean up scripts

Let's not delete the directory the user provided

Do not instrument globals with opaque types

Add option to invalidate uninstrumented results

Fix pointer offset issue in rt run

Handle llvm function names with spaces

Improved support for exception handling

Collect per-language statistics

Label the num and stats field when printing

Fix types of memset intrinsic calls

Distinguish between symbols to stub and to rename

Stub personality and other functions or globals as weak symbols so we
can provide a backup if they were not linked in.

Better handling of global symbols

Make the available_functions file '\0'-delimited

Add tool to get coverage with PGO Info (llvm#6)

Do not stub malloc/free

Improve access logging

More logging in rts

Wrong callback used for args

Forgot to add masked rw test

Silence warning

PGO based code coverage (llvm#7)

Change dataset

Prevent optimizing away the function we generate inputs for

Only preserve the pgo globals if we instrumented

Remove stray echo

Coverage statistics

Note down the configuration used for jug run and improve customization

Add ability to load profiles to input gen tool (llvm#9)

Fix build

Add branch hints

Iterative retry for ptr comparisons

Add configuration to input gen rt

add puts to allowed funcs

Figure out what value we need fron the branch hints

Handle null ptrs using retry iteration

Support for profile-guided input-gen in scripts

Wrap the entire input-gen in a try block and flag failures for retrying

Implement support for unreachable (and noreturn calls)

Do not replace invokes, only call insts

Remove jug dependency on single node mig

Make it possible to set a different jugdir

Fix missing num bb executed entries

Fix issue with assigning instead of appending to num bbs executed

Find possible callee candidates for function pointers and select among those.

This (currently) has a few restrictions:
- Attributor has to find possible callees in the first place.
- Only function pointers being handed directly to the function under investigation are handled.

Generalize FPtr handling - now also works on memory accesses.

Dont memoize calls across A.run().

Drop MD_dbg when stubbing a declaration.

And silence some fp info.

Merge equivalent fp globals and stubs

Add requirements.txt for the scripts

Limit the allowed AAs for the Attributor to reduce failure surface.

Move FP selection to InputGenRTTy to contain randomness.

Fix instrumentation dying due to eager value erasure.

Add command line argument for disabling FP handling.

Don't add parent function to call's callee list.

This is to prevent endless recursion via function pointers..

Also add --disable-fp-handling to python tooling.

Keep Attributor from replacing indirect calls with just one assumed callee by a direct call.

This makes it impossible for us to hook into this and e.g. provide our stub as an alternative..

Fix running lit suite with fp handling.

Ignore all constant function pointer values..

Virtual function calls...?

Per-language mig

Add env var to control fp handling

Typo......

Remove old and obsolete main renaming

Fix errors in python scripts for some configurations

`swifterror` parameters must be special `alloca`s.

silence difference warning when looking at jug results

Introduce AS casts, remove tokens, initialize callbacks earlier

Fix some FP issues (likely to clash)

Support array types and avoid bad casts

Make sure pointer comparisons do not evaluate differently in input-run

More array type support

Do not instrument accesses to the reload of globals (to undo
indirection)

User internal, not private linkage for functions

Test comparisons of zero-sized objects

Add ABI attributes for fp stubs. Likely needs to be checked for other callees too

Make entry -> Fn calls ABI compatible

Compare ABI info for potential callees

Add test for a global relocation we fail

Only update output with cmp info if cmp is not empty

Do not use an entire object for each global - bundle them together

Add DISABLE env vars for ablation instead of ENABLE

Add test for global input relocation

Booleans are too hard

Properly pass and use branch profile flags

Access implicit ABI copy elements to ensure they exists

Fix masked rw test

Give object idx slightly more bits

This brings the default max obj to 1024

Make run mig script more configurable

Do not reuse the same pass infra for both gen and run instrumentation

Disable specialization for callees

Collect per-seed statistics

Fix assertion with unknown sentinel

Strip unknown operand bundles

Keep track of statistics about unreachable exits

Revert accidentally masked instrumentation failures

Fix script crash when we failed instrumentation

Make sure not to inline the callee in the entry func

This caused instructions that use specific cpu features to fail lowering

Strip debug info before handling module

Handle unknown probe-stack functions

Hijack free function

Rewrite gatherFunctionPtrCallees to not rely on IndirectCalleeSpecial…
…izationCallback to gather the candidates.

Instead, select the calls in the beginning and then read the callee metadata.
However, this relies on a patch of the Attributor to not eliminate Calls with seemingly no callees.

Adapt masked_rw to current state.

Don't emit access_ptr for stderr/stdout.

In gen, overwrite load with valid fptr if not a known fptr so far.

Do not delete invoke insts when selecting fp

Revert "In gen, overwrite load with valid fptr if not a known fptr so far."

This reverts commit e278687.

Add calloc to allowed functions

Add timing capabilities to input gen runtimes

Globals can never be null

Fix test

Invalidate retry info

Fix nullptr deref

Fix single module scripts

remove stray include

Further fixes to the scripts

Add --function flag to igm.py

Instrument after profile is put in place

Change clock resolution to nanosecs

Add timing capabilities to igm.py

Use branch profiles directly (not frequencies)

Fix typo

Do not backtrack for pointers we can never match (user managed ones)

Add a penalty for UnreachableInst

Add more detailed timing to the runtimes

Exit when input-gen is not in PATH

Fix input ran statistics

Update README

Dont tweak globals for record

Add input record runtime and refactor

Test file

file name

Now we can record arguments

Track mallocs

Init globals

Hook up to object management

WIP custom allocator

Obj custom malloc

Fix off-by-one error

Minor fixes

Dump input file

Record only once

Refactor dump input function

Print to stderr

Rename to rt-replay

Revert "Rename to rt-replay"

This reverts commit dcc567c.

Fix input-gen (branch hints not working??)

Magic number and mode

Rename

NFC refactor ObjectAddressing

Fix magix number

Recorded input replaying works!

Forgot to add test

Rename InputOut -> File

Refactor

WIP Fancier object addressing

WIP LinkedList Node

WIP fancy object handling

WIP logging

WIP

Initial version of alt object addressing

WIP make replay work

WIP

WIP rt-run compiles

Fix getObjects

Fix bugs with Object addressing

Comments re linked list node

WIP move to compiler-rt

Refactoring

Report OA structure

Make ArrayNode allocate all its children immediately

Fix various bugs

Merge the two inputgen classes

Enable timing in record rt

Quick hack to enable recorded input replaying

Enable lto for inputgen runtimes

Make Used a bit array

Experiment with static size obj

WIP Another strategy

Move inputrecord pass

Add more interfaces

Somehwat working, 10x overhead or something
ivanradanov pushed a commit that referenced this pull request Feb 17, 2025
This will be sent by Arm's Guarded Control Stack extension when an
invalid return is executed.

The signal does have an address we could show, but it's the PC at which
the fault occured. The debugger has plenty of ways to show you that
already, so I've left it out.

```
(lldb) c
Process 460 resuming
Process 460 stopped
* thread #1, name = 'test', stop reason = signal SIGSEGV: control protection fault
    frame #0: 0x0000000000400784 test`main at main.c:57:1
   54  	  afunc();
   55  	  printf("return from main\n");
   56  	  return 0;
-> 57  	}
(lldb) dis
<...>
->  0x400784 <+100>: ret
```

The new test case generates the signal by corrupting the link register
then attempting to return. This will work whether we manually enable GCS
or the C library does it for us.

(in the former case you could just return from main and it would fault)
ivanradanov pushed a commit that referenced this pull request Feb 17, 2025
llvm#123877)

Reverts llvm#122811 due to buildbot breakage e.g.,
https://lab.llvm.org/buildbot/#/builders/52/builds/5421/steps/11/logs/stdio

ASan output from local re-run:
```
==2780289==ERROR: AddressSanitizer: use-after-poison on address 0x7e0b87e28d28 at pc 0x55a979a99e7e bp 0x7ffe4b18f0b0 sp 0x7ffe4b18f0a8
READ of size 1 at 0x7e0b87e28d28 thread T0
    #0 0x55a979a99e7d in getStorageClass /usr/local/google/home/thurston/buildbot_repro/llvm-project/llvm/include/llvm/Object/COFF.h:344
    #1 0x55a979a99e7d in isSectionDefinition /usr/local/google/home/thurston/buildbot_repro/llvm-project/llvm/include/llvm/Object/COFF.h:429:9
    #2 0x55a979a99e7d in getSymbols /usr/local/google/home/thurston/buildbot_repro/llvm-project/lld/COFF/LLDMapFile.cpp:54:42
    llvm#3 0x55a979a99e7d in lld::coff::writeLLDMapFile(lld::coff::COFFLinkerContext const&) /usr/local/google/home/thurston/buildbot_repro/llvm-project/lld/COFF/LLDMapFile.cpp:103:40
    llvm#4 0x55a979a16879 in (anonymous namespace)::Writer::run() /usr/local/google/home/thurston/buildbot_repro/llvm-project/lld/COFF/Writer.cpp:810:3
    llvm#5 0x55a979a00aac in lld::coff::writeResult(lld::coff::COFFLinkerContext&) /usr/local/google/home/thurston/buildbot_repro/llvm-project/lld/COFF/Writer.cpp:354:15
    llvm#6 0x55a97985f7ed in lld::coff::LinkerDriver::linkerMain(llvm::ArrayRef<char const*>) /usr/local/google/home/thurston/buildbot_repro/llvm-project/lld/COFF/Driver.cpp:2826:3
    llvm#7 0x55a97984cdd3 in lld::coff::link(llvm::ArrayRef<char const*>, llvm::raw_ostream&, llvm::raw_ostream&, bool, bool) /usr/local/google/home/thurston/buildbot_repro/llvm-project/lld/COFF/Driver.cpp:97:15
    llvm#8 0x55a9797f9793 in lld::unsafeLldMain(llvm::ArrayRef<char const*>, llvm::raw_ostream&, llvm::raw_ostream&, llvm::ArrayRef<lld::DriverDef>, bool) /usr/local/google/home/thurston/buildbot_repro/llvm-project/lld/Common/DriverDispatcher.cpp:163:12
    llvm#9 0x55a9797fa3b6 in operator() /usr/local/google/home/thurston/buildbot_repro/llvm-project/lld/Common/DriverDispatcher.cpp:188:15
    llvm#10 0x55a9797fa3b6 in void llvm::function_ref<void ()>::callback_fn<lld::lldMain(llvm::ArrayRef<char const*>, llvm::raw_ostream&, llvm::raw_ostream&, llvm::ArrayRef<lld::DriverDef>)::$_0>(long) /usr/local/google/home/thurston/buildbot_repro/llvm-project/llvm/include/llvm/ADT/STLFunctionalExtras.h:46:12
    llvm#11 0x55a97966cb93 in operator() /usr/local/google/home/thurston/buildbot_repro/llvm-project/llvm/include/llvm/ADT/STLFunctionalExtras.h:69:12
    llvm#12 0x55a97966cb93 in llvm::CrashRecoveryContext::RunSafely(llvm::function_ref<void ()>) /usr/local/google/home/thurston/buildbot_repro/llvm-project/llvm/lib/Support/CrashRecoveryContext.cpp:426:3
    llvm#13 0x55a9797f9dc3 in lld::lldMain(llvm::ArrayRef<char const*>, llvm::raw_ostream&, llvm::raw_ostream&, llvm::ArrayRef<lld::DriverDef>) /usr/local/google/home/thurston/buildbot_repro/llvm-project/lld/Common/DriverDispatcher.cpp:187:14
    llvm#14 0x55a979627512 in lld_main(int, char**, llvm::ToolContext const&) /usr/local/google/home/thurston/buildbot_repro/llvm-project/lld/tools/lld/lld.cpp:103:14
    llvm#15 0x55a979628731 in main /usr/local/google/home/thurston/buildbot_repro/llvm_build_asan/tools/lld/tools/lld/lld-driver.cpp:17:10
    llvm#16 0x7ffb8b202c89 in __libc_start_call_main csu/../sysdeps/nptl/libc_start_call_main.h:58:16
    llvm#17 0x7ffb8b202d44 in __libc_start_main csu/../csu/libc-start.c:360:3
    llvm#18 0x55a97953ef60 in _start (/usr/local/google/home/thurston/buildbot_repro/llvm_build_asan/bin/lld+0x8fd1f60)
```
ivanradanov pushed a commit that referenced this pull request Feb 17, 2025
Prevents avoidable memory leaks.

Looks like exchange added in aa1333a
didn't take "continue" into account.

```
==llc==2150782==ERROR: LeakSanitizer: detected memory leaks
Direct leak of 10 byte(s) in 1 object(s) allocated from:
    #0 0x5f1b0f9ac14a in strdup llvm-project/compiler-rt/lib/asan/asan_interceptors.cpp:593:3
    #1 0x5f1b1768428d in FileToRemoveList llvm-project/llvm/lib/Support/Unix/Signals.inc:105:55
```
ivanradanov pushed a commit that referenced this pull request Feb 18, 2025
…ible (llvm#123752)

This patch adds a new option `-aarch64-enable-zpr-predicate-spills`
(which is disabled by default), this option replaces predicate spills
with vector spills in streaming[-compatible] functions.

For example:

```
str	p8, [sp, llvm#7, mul vl]            // 2-byte Folded Spill
// ...
ldr	p8, [sp, llvm#7, mul vl]            // 2-byte Folded Reload
```

Becomes:

```
mov	z0.b, p8/z, #1
str	z0, [sp]                        // 16-byte Folded Spill
// ...
ldr	z0, [sp]                        // 16-byte Folded Reload
ptrue	p4.b
cmpne	p8.b, p4/z, z0.b, #0
```

This is done to avoid streaming memory hazards between FPR/vector and
predicate spills, which currently occupy the same stack area even when
the `-aarch64-stack-hazard-size` flag is set.

This is implemented with two new pseudos SPILL_PPR_TO_ZPR_SLOT_PSEUDO
and FILL_PPR_FROM_ZPR_SLOT_PSEUDO. The expansion of these pseudos
handles scavenging the required registers (z0 in the above example) and,
in the worst case spilling a register to an emergency stack slot in the
expansion. The condition flags are also preserved around the `cmpne` in
case they are live at the expansion point.
ivanradanov pushed a commit that referenced this pull request Jun 4, 2025
`clang-repl --cuda` was previously crashing with a segmentation fault,
instead of reporting a clean error
```
(base) anutosh491@Anutoshs-MacBook-Air bin % ./clang-repl --cuda
#0 0x0000000111da4fbc llvm::sys::PrintStackTrace(llvm::raw_ostream&, int) (/opt/local/libexec/llvm-20/lib/libLLVM.dylib+0x150fbc)
#1 0x0000000111da31dc llvm::sys::RunSignalHandlers() (/opt/local/libexec/llvm-20/lib/libLLVM.dylib+0x14f1dc)
#2 0x0000000111da5628 SignalHandler(int) (/opt/local/libexec/llvm-20/lib/libLLVM.dylib+0x151628)
llvm#3 0x000000019b242de4 (/usr/lib/system/libsystem_platform.dylib+0x180482de4)
llvm#4 0x0000000107f638d0 clang::IncrementalCUDADeviceParser::IncrementalCUDADeviceParser(std::__1::unique_ptr<clang::CompilerInstance, std::__1::default_delete<clang::CompilerInstance>>, clang::CompilerInstance&, llvm::IntrusiveRefCntPtr<llvm::vfs::InMemoryFileSystem>, llvm::Error&, std::__1::list<clang::PartialTranslationUnit, std::__1::allocator<clang::PartialTranslationUnit>> const&) (/opt/local/libexec/llvm-20/lib/libclang-cpp.dylib+0x216b8d0)
llvm#5 0x0000000107f638d0 clang::IncrementalCUDADeviceParser::IncrementalCUDADeviceParser(std::__1::unique_ptr<clang::CompilerInstance, std::__1::default_delete<clang::CompilerInstance>>, clang::CompilerInstance&, llvm::IntrusiveRefCntPtr<llvm::vfs::InMemoryFileSystem>, llvm::Error&, std::__1::list<clang::PartialTranslationUnit, std::__1::allocator<clang::PartialTranslationUnit>> const&) (/opt/local/libexec/llvm-20/lib/libclang-cpp.dylib+0x216b8d0)
llvm#6 0x0000000107f6bac8 clang::Interpreter::createWithCUDA(std::__1::unique_ptr<clang::CompilerInstance, std::__1::default_delete<clang::CompilerInstance>>, std::__1::unique_ptr<clang::CompilerInstance, std::__1::default_delete<clang::CompilerInstance>>) (/opt/local/libexec/llvm-20/lib/libclang-cpp.dylib+0x2173ac8)
llvm#7 0x000000010206f8a8 main (/opt/local/libexec/llvm-20/bin/clang-repl+0x1000038a8)
llvm#8 0x000000019ae8c274
Segmentation fault: 11
```

The underlying issue was that the `DeviceCompilerInstance` (used for
device-side CUDA compilation) was never initialized with a `Sema`, which
is required before constructing the `IncrementalCUDADeviceParser`.

https://github.com/llvm/llvm-project/blob/89687e6f383b742a3c6542dc673a84d9f82d02de/clang/lib/Interpreter/DeviceOffload.cpp#L32

https://github.com/llvm/llvm-project/blob/89687e6f383b742a3c6542dc673a84d9f82d02de/clang/lib/Interpreter/IncrementalParser.cpp#L31

Unlike the host-side `CompilerInstance` which runs `ExecuteAction`
inside the Interpreter constructor (thereby setting up Sema), the
device-side CI was passed into the parser uninitialized, leading to an
assertion or crash when accessing its internals.

To fix this, I refactored the `Interpreter::create` method to include an
optional `DeviceCI` parameter. If provided, we know we need to take care
of this instance too. Only then do we construct the
`IncrementalCUDADeviceParser`.

(cherry picked from commit 21fb19f)
ivanradanov pushed a commit that referenced this pull request Jun 4, 2025
llvm#138091)

Check this error for more context
(https://github.com/compiler-research/CppInterOp/actions/runs/14749797085/job/41407625681?pr=491#step:10:531)

This fails with
```
* thread #1, name = 'CppInterOpTests', stop reason = signal SIGSEGV: address not mapped to object (fault address: 0x55500356d6d3)
  * frame #0: 0x00007fffee41cfe3 libclangCppInterOp.so.21.0gitclang::PragmaNamespace::~PragmaNamespace() + 99
    frame #1: 0x00007fffee435666 libclangCppInterOp.so.21.0gitclang::Preprocessor::~Preprocessor() + 3830
    frame #2: 0x00007fffee20917a libclangCppInterOp.so.21.0gitstd::_Sp_counted_base<(__gnu_cxx::_Lock_policy)2>::_M_release() + 58
    frame llvm#3: 0x00007fffee224796 libclangCppInterOp.so.21.0gitclang::CompilerInstance::~CompilerInstance() + 838
    frame llvm#4: 0x00007fffee22494d libclangCppInterOp.so.21.0gitclang::CompilerInstance::~CompilerInstance() + 13
    frame llvm#5: 0x00007fffed95ec62 libclangCppInterOp.so.21.0gitclang::IncrementalCUDADeviceParser::~IncrementalCUDADeviceParser() + 98
    frame llvm#6: 0x00007fffed9551b6 libclangCppInterOp.so.21.0gitclang::Interpreter::~Interpreter() + 102
    frame llvm#7: 0x00007fffed95598d libclangCppInterOp.so.21.0gitclang::Interpreter::~Interpreter() + 13
    frame llvm#8: 0x00007fffed9181e7 libclangCppInterOp.so.21.0gitcompat::createClangInterpreter(std::vector<char const*, std::allocator<char const*>>&) + 2919
```

Problem :

1) The destructor currently handles no clearance for the DeviceParser
and the DeviceAct. We currently only have this

https://github.com/llvm/llvm-project/blob/976493822443c52a71ed3c67aaca9a555b20c55d/clang/lib/Interpreter/Interpreter.cpp#L416-L419

2) The ownership for DeviceCI currently is present in
IncrementalCudaDeviceParser. But this should be similar to how the
combination for hostCI, hostAction and hostParser are managed by the
Interpreter. As on master the DeviceAct and DeviceParser are managed by
the Interpreter but not DeviceCI. This is problematic because :
IncrementalParser holds a Sema& which points into the DeviceCI. On
master, DeviceCI is destroyed before the base class ~IncrementalParser()
runs, causing Parser::reset() to access a dangling Sema (and as Sema
holds a reference to Preprocessor which owns PragmaNamespace) we see
this
```
  * frame #0: 0x00007fffee41cfe3 libclangCppInterOp.so.21.0gitclang::PragmaNamespace::~PragmaNamespace() + 99
    frame #1: 0x00007fffee435666 libclangCppInterOp.so.21.0gitclang::Preprocessor::~Preprocessor() + 3830

```

(cherry picked from commit 529b6fc)
ivanradanov pushed a commit that referenced this pull request Jun 13, 2025
…142952)

This was removed in llvm#135343 in
favour of making it a format variable, which we do here. This follows
the precedent of the `[opt]` and `[artificial]` markers.

Before:
```
 thread #1, queue = 'com.apple.main-thread', stop reason = breakpoint 1.2
 * frame #0: 0x000000010000037c a.out`inlined1() at inline.cpp:4:3
   frame #1: 0x000000010000037c a.out`regular() at inline.cpp:6:17
   frame #2: 0x00000001000003b8 a.out`inlined2() at inline.cpp:7:43
   frame llvm#3: 0x00000001000003b4 a.out`main at inline.cpp:10:3
   frame llvm#4: 0x0000000186345be4 dyld`start + 7040
```

After (note the `[inlined]` markers):
```
thread #1, queue = 'com.apple.main-thread', stop reason = breakpoint 1.2
* frame #0: 0x000000010000037c a.out`inlined1() at inline.cpp:4:3 [inlined]
  frame #1: 0x000000010000037c a.out`regular() at inline.cpp:6:17
  frame #2: 0x00000001000003b8 a.out`inlined2() at inline.cpp:7:43 [inlined]
  frame llvm#3: 0x00000001000003b4 a.out`main at inline.cpp:10:3
  frame llvm#4: 0x0000000186345be4 dyld`start + 7040
```

rdar://152642178
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant