Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
205 commits
Select commit Hold shift + click to select a range
aa94973
More refactoring
lockshaw Jan 13, 2023
2ee2548
Further restructuring
lockshaw Jan 14, 2023
fdc83f2
Pin spdlog version
lockshaw Jan 14, 2023
609a128
Add framework for quickcheck-style testing
lockshaw Jan 14, 2023
f19d772
Operator params refactoring
lockshaw Jan 15, 2023
891e47e
Operator and parallel dim mapping record refactoring
lockshaw Jan 27, 2023
2cfbda5
More operator params fixing
lockshaw Jan 28, 2023
447904c
More param refactoring
lockshaw Jan 29, 2023
5926089
Fix some includes
reyna-abhyankar Jan 31, 2023
9252661
Add operator params interface
lockshaw Feb 1, 2023
9b9b01c
Merge remote-tracking branch 'lockshaw/re/gfmgn' into re/gfmgn
lockshaw Feb 1, 2023
625d701
Fix up logging, start simplifying graph library
lockshaw Feb 1, 2023
c90c3c8
Add framework for testing simplified graph library
lockshaw Feb 1, 2023
a979f1e
Fix operator includes
reyna-abhyankar Feb 2, 2023
8154018
Continued testing and graph library
lockshaw Feb 3, 2023
dfc0cb0
Merge remote-tracking branch 'lockshaw/re/gfmgn' into re/gfmgn
lockshaw Feb 3, 2023
2b9ff71
Fix graph tests
lockshaw Feb 8, 2023
6907e1b
Fix include
reyna-abhyankar Feb 9, 2023
6e695ff
[ElementUnary] Kernel refactor
reyna-abhyankar Feb 9, 2023
c5cdcc8
Add dfs traverals and is_acyclic
lockshaw Feb 10, 2023
9b9b69f
Add additional acyclic subcase
lockshaw Feb 10, 2023
abf66bc
[MultiHeadAttention] Kernels
reyna-abhyankar Feb 10, 2023
2290e24
Merge remote-tracking branch 'lockshaw/re/gfmgn' into repo-refactor
reyna-abhyankar Feb 10, 2023
f28ac9f
More simplified graph library
lockshaw Feb 13, 2023
3f0eac1
Merge remote-tracking branch 'origin/repo-refactor' into re/gfmgn
lockshaw Feb 13, 2023
7c21f72
Update spdlog and rapidcheck deps to use https address to avoid ssh p…
Feb 13, 2023
8790141
Merge branch 'master' into repo-refactor
reyna-abhyankar Feb 18, 2023
d767d1c
Move kernel functions and params
reyna-abhyankar Feb 18, 2023
de15809
Fix compile error in operator_params
wmdi Feb 21, 2023
9ab8f26
Fix namespaces
lockshaw Feb 22, 2023
4042cd9
Merge remote-tracking branch 'refs/remotes/origin/repo-refactor' into…
lockshaw Feb 22, 2023
976f757
setup bin
wmdi Feb 22, 2023
0dd6f11
Add visit_struct
lockshaw Feb 24, 2023
3ada8e8
Merge remote-tracking branch 'refs/remotes/origin/repo-refactor' into…
lockshaw Feb 24, 2023
a7acc82
Add substitutions lib and fix cmake
lockshaw Feb 25, 2023
4fb75c2
Add initial draft of sp decomposition
lockshaw Feb 26, 2023
f5334c7
Start refactoring substitutions
lockshaw Feb 27, 2023
731b747
Add first draft of substitution logic
lockshaw Mar 1, 2023
ea94f9a
Continue drafting unity search algorithm
lockshaw Mar 2, 2023
5a78f78
Remove accidental fmt submodule
lockshaw Mar 3, 2023
38a4a0b
Do some rearranging in ffr
lockshaw Mar 3, 2023
ad0d451
Remaining params -> attrs for clarity
lockshaw Mar 3, 2023
da028fd
Additional cleaning and reordering
lockshaw Mar 3, 2023
483d393
Fix some cmake issues
lockshaw Mar 3, 2023
64e9076
Fix includes and update based on renaming
reyna-abhyankar Mar 9, 2023
4419407
Move kernel fns
reyna-abhyankar Mar 9, 2023
296e54a
ADd cuda flag
lockshaw Mar 9, 2023
354a4c2
Merge remote-tracking branch 'refs/remotes/origin/repo-refactor' into…
lockshaw Mar 9, 2023
644b15b
Add FF_USE_* macro definitions
lockshaw Mar 10, 2023
fd98482
Add initial draft of task_specs
lockshaw Mar 13, 2023
988c0f2
Add imaginary accessor interface
lockshaw Mar 13, 2023
128d44c
agg spec kernels
reyna-abhyankar Mar 16, 2023
c997393
aggregate kernels
reyna-abhyankar Mar 16, 2023
daf5763
Layer norm kernels
reyna-abhyankar Mar 16, 2023
1274b65
reduce kernels
reyna-abhyankar Mar 16, 2023
43d4a09
reverse kernels
reyna-abhyankar Mar 16, 2023
ea1e964
Add most of implementation of task specs
lockshaw Mar 17, 2023
64b03b4
Merge remote-tracking branch 'refs/remotes/origin/repo-refactor' into…
lockshaw Mar 17, 2023
0f99d3b
Enable CMake to generate position independent code (-fPIC). This is n…
Mar 17, 2023
a2eef45
Merge branch 'repo-refactor' of https://github.com/flexflow/FlexFlow …
reyna-abhyankar Mar 17, 2023
d278e02
topk kernels
reyna-abhyankar Mar 17, 2023
a592985
Try out a bunch of likely-unnecessary template metaprogramming
lockshaw Mar 17, 2023
002407f
Merge remote-tracking branch 'refs/remotes/origin/repo-refactor' into…
lockshaw Mar 17, 2023
8b871bb
Rename op-impl to kernels
lockshaw Mar 17, 2023
bc18765
Fix up batchnorm kernels
lockshaw Mar 17, 2023
91c2735
Batch norm implementation kernel calls
lockshaw Mar 17, 2023
0185c3e
Remove cache operator
lockshaw Mar 17, 2023
bee2525
Fix kernel includes
reyna-abhyankar Mar 21, 2023
756d891
Dropout kernels [placeholder mod]
reyna-abhyankar Mar 21, 2023
6450c62
Fix dropout
reyna-abhyankar Mar 22, 2023
a47b023
Move cuda and hip helpers, fix elem unary
reyna-abhyankar Mar 22, 2023
6dfadf9
Work on de-legioning kernels and some renaming
lockshaw Mar 22, 2023
b2644f7
Merge remote-tracking branch 'refs/remotes/origin/repo-refactor' into…
lockshaw Mar 22, 2023
86a1c94
Add cast dispatch mechanism
lockshaw Mar 23, 2023
d80dd39
Update combine to use dt dispatch
lockshaw Mar 23, 2023
2b95657
Partial concat updates
lockshaw Mar 23, 2023
3fab3f2
Work on v2 of taskspec interface
lockshaw Mar 24, 2023
21519f9
Further task_spec and serialization work
lockshaw Mar 27, 2023
495d274
Use task_spec tensor acc for aggregate_spec
lockshaw Mar 27, 2023
b1b75d7
Work on implementing OpTaskArgumentAccessor
lockshaw Mar 27, 2023
619a580
Implement tensor accessing
lockshaw Mar 29, 2023
bba6627
Implement argument access
lockshaw Mar 29, 2023
fe40602
Remove kernel wrapper functions
reyna-abhyankar Mar 31, 2023
ef6741b
Further task spec refactoring
lockshaw Apr 1, 2023
7ebc898
Merge remote-tracking branch 'refs/remotes/origin/repo-refactor' into…
lockshaw Apr 1, 2023
9ca3ee2
Runtime reorganization
lockshaw Apr 1, 2023
ff24cdb
OpMeta fixes
lockshaw Apr 1, 2023
df52d90
Fix some include not founds
lockshaw Apr 1, 2023
d201048
Rename visitable
lockshaw Apr 1, 2023
e59acae
De-virtualize op-attrs
lockshaw Apr 1, 2023
52cd30d
Large number of runtime build error fixes and other improvements
lockshaw Apr 2, 2023
b39ddda
Further model.cc refactoring
lockshaw Apr 2, 2023
09c4873
Create even more compile errors
lockshaw Apr 3, 2023
d5bb0ab
DataTypeDispatch for all kernels
reyna-abhyankar Apr 7, 2023
22a44fd
Start refactoring modelspec
lockshaw Apr 10, 2023
e4433b8
Add mutability back to labelled open multi di graph
lockshaw Apr 10, 2023
25a1335
Add fmt, expected, continue ModelSpec
lockshaw Apr 10, 2023
6f60a4c
Make DeviceID a strong_typedef
lockshaw Apr 10, 2023
adc3efc
Fix a bunch of virtual issues
lockshaw Apr 11, 2023
762b304
Add a bunch of static_asserts
lockshaw Apr 11, 2023
125d76a
Refactor visitable cmp
lockshaw Apr 12, 2023
454edee
Fused and fused parallel
reyna-abhyankar Apr 14, 2023
3f2945e
Add tensordims, add graphview infra
lockshaw Apr 14, 2023
906e11f
Merge remote-tracking branch 'refs/remotes/origin/repo-refactor' into…
lockshaw Apr 14, 2023
c55304d
fix INodeLabelledMultiDiGraph polymorphic copy compliant
williamberman Apr 15, 2023
5a04746
remove dup formatter templates for for MultiDi{Input,Output}
williamberman Apr 15, 2023
c7098ac
unsafe_view_as_flipped take IDiGraphView
williamberman Apr 16, 2023
074fda1
add static asserts for abstract struct IUndirectedGraphView
williamberman Apr 16, 2023
ad1fd92
add UndirectedGraphView
williamberman Apr 16, 2023
d5a9aa9
update CXX_STANDARD to 17 for utils
williamberman Apr 16, 2023
0e6419a
add update to header file to match change to impl
williamberman Apr 16, 2023
33d063a
Update some function signatures
lockshaw Apr 16, 2023
9de144e
Merge remote-tracking branch 'refs/remotes/origin/repo-refactor' into…
lockshaw Apr 16, 2023
e0fea42
Merge commit "Add multi-objective global memory search algorithm"
Apr 17, 2023
62eae1f
Merge commit '891f043d63101fd206c6f702705aaea55ff20afa' into repo-ref…
Apr 17, 2023
21864a4
Merge commit '40c53d33cf32ce765218646996001ba2189c1052' into repo-ref…
Apr 17, 2023
a064a62
Merge commit 'cce94810c03189cb851d3846da7a1a63df8c61ad' into repo-ref…
Apr 17, 2023
81b445f
Merge commit 'df458baa49d5f4f311604152bc725a00e37335eb' into repo-ref…
Apr 17, 2023
5e4bb27
Move the file locations that couldn't be done when merging the commits
Apr 17, 2023
fb68554
Fix utils enough to get to linking stage
lockshaw Apr 18, 2023
82e42e1
TSR BatchMatmul, fixes for aggregate, MHA
reyna-abhyankar Apr 19, 2023
a44f915
Implement undirected get_subgraph
lockshaw Apr 20, 2023
72ca852
TaskSpec refactor (1/n)
reyna-abhyankar Apr 25, 2023
7444db2
non-op task spec and initializer refactoring
lockshaw Apr 28, 2023
9ed8b27
Start on refactoring ops
lockshaw May 4, 2023
a29bba2
More movement toward final op and task_spec interfaces
lockshaw May 5, 2023
3a73780
More op_task_spec -> task_spec resolution
lockshaw May 5, 2023
f35405a
Optimizer and taskspec improvements
lockshaw May 10, 2023
6d91e1b
Dropout with new task spec, tests
reyna-abhyankar May 12, 2023
de7687a
Start to implement high-level execution coordination
lockshaw May 13, 2023
b4fab27
Merge remote-tracking branch 'refs/remotes/origin/repo-refactor' into…
lockshaw May 13, 2023
3dfbf18
Add SimTaskBinding interface to ease writing measure_operator_cost
lockshaw May 14, 2023
138d3c7
Various fixes moving towards invocation interpretation
lockshaw May 15, 2023
997297a
Fixes to tests, agg/agg_spec
reyna-abhyankar May 17, 2023
44611f1
Renaming and continued task invocation work
lockshaw May 19, 2023
b38d062
Merge remote-tracking branch 'refs/remotes/origin/repo-refactor' into…
lockshaw May 19, 2023
62247cc
Rapidcheck for serialization
reyna-abhyankar May 24, 2023
6633a09
OpTaskSpec interface
reyna-abhyankar May 24, 2023
7e4294a
Split up task invocation compilation logic
lockshaw May 25, 2023
f50f2f6
Merge remote-tracking branch 'refs/remotes/origin/repo-refactor' into…
lockshaw May 25, 2023
bf10b9c
rapidcheck fix, among others
lockshaw Jun 1, 2023
e92fa78
Continue pulling task invocations together at the top level
lockshaw Jun 1, 2023
f0c6438
Start sketching out high level flow and c ffi
lockshaw Jun 2, 2023
d7aa71d
More ffi work
lockshaw Jun 2, 2023
42eaa5e
Start to define bindings and serialization
lockshaw Jun 6, 2023
d0a61fa
Task spec cleanup
lockshaw Jun 7, 2023
21bab2d
Add task_spec readme
lockshaw Jun 7, 2023
93a3aff
Add argument types to task_spec readme
lockshaw Jun 7, 2023
e7d77c7
Attempt to fix lib README mermaid
lockshaw Jun 7, 2023
ae4b67b
Add cow capabilities for MultiDiGraph
lockshaw Jun 7, 2023
4dbf8ad
Update build instructions for repo-refactor
lockshaw Jun 8, 2023
34479ac
Merge branch 'master' into re/gfmgn
lockshaw Jun 8, 2023
7dcc58d
Format
lockshaw Jun 8, 2023
88fc8b2
Prevent format.sh from formatting triton/
lockshaw Jun 8, 2023
4b2b23d
fix the cow_ptr_t
lambda7xx Jun 8, 2023
d6a9dbf
Add first part of graph readme and refactor multidigraph indices
lockshaw Jun 8, 2023
34dec86
Revert "fix the cow_ptr_t"
lockshaw Jun 8, 2023
cc2de12
Merge remote-tracking branch 'origin/repo-refactor' into repo-refactor
lockshaw Jun 8, 2023
d4f2ef6
Fix fa glyphs in graph/README.md
lockshaw Jun 8, 2023
1e1f48a
Fix formatting issue
lockshaw Jun 9, 2023
fa3f0bc
Add cow_ptr_t fix along the lines of @lambda7xx #758
lockshaw Jun 9, 2023
6ef6942
Add example graph->view coercion
lockshaw Jun 9, 2023
d25fc89
Simplify and remove some unecessary copies from cow_ptr_t
lockshaw Jun 9, 2023
cf148b9
Fix json and some other pcg bugs
lockshaw Jun 11, 2023
4c91774
Find good middle path for constructor creation
lockshaw Jun 28, 2023
cc18b3b
Cleanup new visitable aggregate interface
lockshaw Jun 28, 2023
4f434ac
Move most of op-attrs over to new visitable interface
lockshaw Jun 28, 2023
d4f6987
Add fixes and refactoring for computation graph json serialization
lockshaw Jun 30, 2023
2af63aa
Start on internals diagram
lockshaw Jun 30, 2023
175fb72
Point internals diagram link to raw svg
lockshaw Jun 30, 2023
08e4987
Label Chart Elements (#828)
KateUnger Jul 4, 2023
d8d545e
Add dynamo to diagram
lockshaw Jul 5, 2023
c969a44
Merge remote-tracking branch 'refs/remotes/origin/repo-refactor' into…
lockshaw Jul 5, 2023
3de4555
Add participant reminders in tracing diagram
lockshaw Jul 5, 2023
6ea611a
Add code snippet to pytorch diagram
lockshaw Jul 5, 2023
cda0f79
Update v1/parallel_tensor.h to new visitable interface
lockshaw Jul 5, 2023
66efb4c
Start working on serialization
lockshaw Jul 6, 2023
904677d
Attempt fix of the cuda_fp16.h build issue (#834)
lockshaw Jul 6, 2023
7ef9985
Move views.h over to non-virtual interface
lockshaw Jul 6, 2023
de03797
Merge remote-tracking branch 'refs/remotes/origin/repo-refactor' into…
lockshaw Jul 6, 2023
0fc19a0
fix the inplace_sorted_by in container.h
lambda7xx Jul 6, 2023
cbb6d12
start to implement the contract revelant
lambda7xx Jul 7, 2023
c20e1a6
finish other method except unsafe related
lambda7xx Jul 7, 2023
b9ba680
add implement for the unsafe_create
lambda7xx Jul 7, 2023
881ecee
add test for algorithm
lambda7xx Jul 7, 2023
1525999
add test for algorithm
lambda7xx Jul 10, 2023
b138d36
refine the code according to the PR
lambda7xx Jul 10, 2023
7368510
refine the PR
lambda7xx Jul 10, 2023
666cf82
fix the doctest
lambda7xx Jul 11, 2023
2ac1e11
refine the code
lambda7xx Jul 11, 2023
2b82bfc
fix the bug
lambda7xx Jul 11, 2023
1ccf5c4
modify the get_imm_post_dominator
lambda7xx Jul 11, 2023
e83b24c
fix the lib/CMakeLists.txt
lambda7xx Jul 11, 2023
375053e
refine the get_weakly_connected_components
lambda7xx Jul 11, 2023
1c8395b
modfiy the lib/CMakeLists.txt
lambda7xx Jul 11, 2023
f2ef339
refine the utils
lambda7xx Jul 12, 2023
380d1df
fix the get_mutable
lambda7xx Jul 13, 2023
20e6835
implement the add_nodes(DiGraph)
lambda7xx Jul 13, 2023
dad3729
use DiGraph::create<AdjacencyDiGraph>() to replacee AdjacncyDiGraph
lambda7xx Jul 13, 2023
19b8df1
use DiGraphView to implement the DiGraph::query_nodes
lambda7xx Jul 13, 2023
179d7c3
use MultiDiGraph in test
lambda7xx Jul 13, 2023
9a372af
remove std::hash for JoinNodeKey
lambda7xx Jul 13, 2023
8b73684
use the fmt
lambda7xx Jul 13, 2023
79237b1
use the optional to replace tl::optional in algorithm.cc
lambda7xx Jul 13, 2023
e54ba53
refine the code
lambda7xx Jul 15, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
5 changes: 3 additions & 2 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -1,3 +1,6 @@
# clang compilation db
compile_commands.json

# Compiled files
/.tools/
/python/flexflow_python
Expand Down Expand Up @@ -25,8 +28,6 @@ dist/
downloads/
eggs/
.eggs/
lib/
lib64/
parts/
sdist/
var/
Expand Down
24 changes: 24 additions & 0 deletions .gitmodules
Original file line number Diff line number Diff line change
Expand Up @@ -19,3 +19,27 @@
[submodule "deps/json"]
path = deps/json
url = https://github.com/nlohmann/json.git
[submodule "deps/spdlog"]
path = deps/spdlog
url = https://github.com/gabime/spdlog.git
[submodule "deps/rapidcheck"]
path = deps/rapidcheck
url = https://github.com/emil-e/rapidcheck.git
[submodule "deps/doctest"]
path = deps/doctest
url = https://github.com/doctest/doctest.git
[submodule "deps/visit_struct"]
path = deps/visit_struct
url = https://github.com/cbeck88/visit_struct.git
[submodule "deps/expected"]
path = deps/expected
url = https://github.com/TartanLlama/expected.git
[submodule "deps/fmt"]
path = deps/fmt
url = https://github.com/fmtlib/fmt.git
[submodule "deps/invoke"]
path = deps/invoke
url = https://github.com/BlackMATov/invoke.hpp.git
[submodule "deps/any"]
path = deps/any
url = https://github.com/thelink2012/any.git
6 changes: 6 additions & 0 deletions .ignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
/deps/
/substitutions/
/triton/
/examples/
/docs/
/build-external/
Loading