Commit e84df28
Improve internal logging functionality by using Python's standard logging module (#1956)
* Initial plan for issue
* Implement standard logging module and integrate with existing loggers
Co-authored-by: jgbradley1 <[email protected]>
* Add test cases and improve documentation for standard logging
Co-authored-by: jgbradley1 <[email protected]>
* Apply ruff formatting and add semversioner file for logging improvements
Co-authored-by: jgbradley1 <[email protected]>
* Remove custom logger classes and refactor to use standard logging only
Co-authored-by: jgbradley1 <[email protected]>
* Apply ruff formatting to resolve CI/CD test failures
Co-authored-by: jgbradley1 <[email protected]>
* Add semversioner file and fix linting issues
Co-authored-by: jgbradley1 <[email protected]>
* ruff fixes
* fix spelling error
* Remove StandardProgressLogger and refactor to use standard logging
Co-authored-by: jgbradley1 <[email protected]>
* Remove LoggerFactory and custom loggers, refactor to use standard logging
Co-authored-by: jgbradley1 <[email protected]>
* Fix pyright error: use logger.info() instead of calling logger as function in cosmosdb_pipeline_storage.py
Co-authored-by: jgbradley1 <[email protected]>
* ruff fixes
* Remove deprecated logger files that were marked as deprecated placeholders
Co-authored-by: jgbradley1 <[email protected]>
* Replace custom get_logger with standard Python logging
Co-authored-by: jgbradley1 <[email protected]>
* Fix linting issues found by ruff check --fix
Co-authored-by: jgbradley1 <[email protected]>
* apply ruff check fixes
* add word to dictionary
* Fix type checker error in ModelManager.__new__ method
Co-authored-by: jgbradley1 <[email protected]>
* Refactor multiple logging.getLogger() calls to use single logger per file
Co-authored-by: jgbradley1 <[email protected]>
* Remove progress_logger parameter from build_index() and logger parameter from generate_indexing_prompts()
Co-authored-by: jgbradley1 <[email protected]>
* Remove logger parameter from run_pipeline and standardize logger naming
Co-authored-by: jgbradley1 <[email protected]>
* Replace logger parameter with log_level parameter in CLI commands
Co-authored-by: jgbradley1 <[email protected]>
* Fix import ordering in notebook files to pass poetry poe check
Co-authored-by: jgbradley1 <[email protected]>
* Remove --logger parameter from smoke test command
Co-authored-by: jgbradley1 <[email protected]>
* Fix Windows CI/CD issue with log file cleanup in tests
Co-authored-by: jgbradley1 <[email protected]>
* Add StreamHandler to root logger in __main__.py for CLI logging
Co-authored-by: jgbradley1 <[email protected]>
* Only add StreamHandler if root logger doesn't have existing StreamHandler
Co-authored-by: jgbradley1 <[email protected]>
* Fix import ordering in notebook files to pass ruff checks
Co-authored-by: jgbradley1 <[email protected]>
* Replace logging.StreamHandler with colorlog.StreamHandler for colorized log output
Co-authored-by: jgbradley1 <[email protected]>
* Regenerate poetry.lock file after adding colorlog dependency
Co-authored-by: jgbradley1 <[email protected]>
* Fix import ordering in notebook files to pass ruff checks
Co-authored-by: jgbradley1 <[email protected]>
* move printing of dataframes to debug level
* remove colorlog for now
* Refactor workflow callbacks to inherit from logging.Handler
Co-authored-by: jgbradley1 <[email protected]>
* Fix linting issues in workflow callback handlers
Co-authored-by: jgbradley1 <[email protected]>
* Fix pyright type errors in blob and file workflow callbacks
Co-authored-by: jgbradley1 <[email protected]>
* Refactor pipeline logging to use pure logging.Handler subclasses
Co-authored-by: jgbradley1 <[email protected]>
* Rename workflow callback classes to workflow logger classes and move to logger directory
Co-authored-by: jgbradley1 <[email protected]>
* update dictionary
* apply ruff fixes
* fix function name
* simplify logger code
* update
* Remove error, warning, and log methods from WorkflowCallbacks and replace with standard logging
Co-authored-by: jgbradley1 <[email protected]>
* ruff fixes
* Fix pyright errors by removing WorkflowCallbacks from strategy type signatures
Co-authored-by: jgbradley1 <[email protected]>
* Remove ConsoleWorkflowLogger and apply consistent formatter to all handlers
Co-authored-by: jgbradley1 <[email protected]>
* apply ruff fixes
* Refactor pipeline_logger.py to use standard FileHandler and remove FileWorkflowLogger
Co-authored-by: jgbradley1 <[email protected]>
* Remove conditional azure import checks from blob_workflow_logger.py
Co-authored-by: jgbradley1 <[email protected]>
* Fix pyright type checking errors in mock_provider.py and utils.py
Co-authored-by: jgbradley1 <[email protected]>
* Run ruff check --fix to fix import ordering in notebooks
Co-authored-by: jgbradley1 <[email protected]>
* Merge configure_logging and create_pipeline_logger into init_loggers function
Co-authored-by: jgbradley1 <[email protected]>
* Remove configure_logging and create_pipeline_logger functions, replace all usage with init_loggers
Co-authored-by: jgbradley1 <[email protected]>
* apply ruff fixes
* cleanup unused code
* Update init_loggers to accept GraphRagConfig instead of ReportingConfig
Co-authored-by: jgbradley1 <[email protected]>
* apply ruff check fixes
* Fix test failures by providing valid GraphRagConfig with required model configurations
Co-authored-by: jgbradley1 <[email protected]>
* apply ruff fixes
* remove logging_workflow_callback
* cleanup logging messages
* Add logging to track progress of pandas DataFrame apply operation in create_base_text_units
Co-authored-by: jgbradley1 <[email protected]>
* cleanup logger logic throughout codebase
* update
* more cleanup of old loggers
* small logger cleanup
* final code cleanup and added loggers to query
* add verbose logging to query
* minor code cleanup
* Fix broken unit tests for chunk_text and standard_logging
Co-authored-by: jgbradley1 <[email protected]>
* apply ruff fixes
* Fix test_chunk_text by mocking progress_ticker function instead of ProgressTicker class
Co-authored-by: jgbradley1 <[email protected]>
* remove unnecessary logger
* remove rich and fix type annotation
* revert test formatting changes my by copilot
* promote graphrag logs to root logger
* add correct semversioner file
* revert change to file
* revert formatting changes that have no effect
* fix changes after merge with main
* revert unnecessary copilot changes
* remove whitespace
* cleanup docstring
* simplify some logic with less code
* update poetry lock file
* ruff fixes
---------
Co-authored-by: copilot-swe-agent[bot] <[email protected]>
Co-authored-by: jgbradley1 <[email protected]>
Co-authored-by: Josh Bradley <[email protected]>1 parent 27c6de8 commit e84df28
File tree
128 files changed
+2134
-2024
lines changed- .semversioner/next-release
- docs/config
- graphrag
- api
- callbacks
- cli
- config
- index
- input
- operations
- build_noun_graph
- np_extractors
- embed_text
- strategies
- extract_covariates
- extract_graph
- layout_graph
- summarize_communities
- graph_context
- text_unit_context
- summarize_descriptions
- run
- text_splitting
- typing
- utils
- workflows
- language_model
- providers/fnllm
- logger
- prompt_tune/loader
- query
- context_builder
- llm
- question_gen
- structured_search
- basic_search
- drift_search
- global_search
- local_search
- storage
- utils
- tests
- integration/storage
- smoke
- unit
- indexing
- operations/chunk_text
- verbs/entities/extraction/strategies/graph_intelligence
- logger
Some content is hidden
Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
128 files changed
+2134
-2024
lines changedLines changed: 4 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
102 | 102 | | |
103 | 103 | | |
104 | 104 | | |
| 105 | + | |
105 | 106 | | |
106 | 107 | | |
107 | 108 | | |
| |||
186 | 187 | | |
187 | 188 | | |
188 | 189 | | |
| 190 | + | |
189 | 191 | | |
190 | 192 | | |
191 | 193 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
178 | 178 | | |
179 | 179 | | |
180 | 180 | | |
181 | | - | |
| 181 | + | |
182 | 182 | | |
183 | 183 | | |
184 | 184 | | |
185 | | - | |
| 185 | + | |
186 | 186 | | |
187 | 187 | | |
188 | 188 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
149 | 149 | | |
150 | 150 | | |
151 | 151 | | |
152 | | - | |
| 152 | + | |
153 | 153 | | |
154 | 154 | | |
155 | 155 | | |
156 | | - | |
| 156 | + | |
157 | 157 | | |
158 | 158 | | |
159 | 159 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
2 | 2 | | |
3 | 3 | | |
4 | 4 | | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
10 | 10 | | |
11 | 11 | | |
12 | 12 | | |
13 | | - | |
| 13 | + | |
14 | 14 | | |
15 | 15 | | |
16 | 16 | | |
| |||
19 | 19 | | |
20 | 20 | | |
21 | 21 | | |
22 | | - | |
23 | | - | |
| 22 | + | |
24 | 23 | | |
25 | | - | |
| 24 | + | |
26 | 25 | | |
27 | 26 | | |
28 | 27 | | |
| |||
31 | 30 | | |
32 | 31 | | |
33 | 32 | | |
34 | | - | |
35 | 33 | | |
36 | 34 | | |
37 | 35 | | |
| |||
45 | 43 | | |
46 | 44 | | |
47 | 45 | | |
48 | | - | |
49 | | - | |
50 | 46 | | |
51 | 47 | | |
52 | 48 | | |
53 | 49 | | |
54 | 50 | | |
55 | 51 | | |
56 | | - | |
57 | | - | |
58 | | - | |
59 | | - | |
| 52 | + | |
60 | 53 | | |
61 | | - | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
62 | 58 | | |
63 | 59 | | |
64 | 60 | | |
65 | 61 | | |
66 | | - | |
| 62 | + | |
67 | 63 | | |
| 64 | + | |
68 | 65 | | |
69 | 66 | | |
70 | 67 | | |
| |||
75 | 72 | | |
76 | 73 | | |
77 | 74 | | |
78 | | - | |
79 | 75 | | |
80 | 76 | | |
81 | 77 | | |
82 | 78 | | |
83 | | - | |
| 79 | + | |
84 | 80 | | |
85 | | - | |
86 | | - | |
| 81 | + | |
| 82 | + | |
87 | 83 | | |
88 | 84 | | |
89 | 85 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
11 | 11 | | |
12 | 12 | | |
13 | 13 | | |
| 14 | + | |
14 | 15 | | |
15 | 16 | | |
16 | 17 | | |
| |||
20 | 21 | | |
21 | 22 | | |
22 | 23 | | |
23 | | - | |
| 24 | + | |
24 | 25 | | |
25 | 26 | | |
26 | 27 | | |
| |||
47 | 48 | | |
48 | 49 | | |
49 | 50 | | |
| 51 | + | |
| 52 | + | |
50 | 53 | | |
51 | 54 | | |
52 | 55 | | |
53 | 56 | | |
54 | | - | |
55 | 57 | | |
56 | 58 | | |
57 | 59 | | |
| |||
71 | 73 | | |
72 | 74 | | |
73 | 75 | | |
74 | | - | |
75 | | - | |
76 | 76 | | |
77 | 77 | | |
78 | 78 | | |
| |||
89 | 89 | | |
90 | 90 | | |
91 | 91 | | |
| 92 | + | |
| 93 | + | |
92 | 94 | | |
93 | 95 | | |
94 | 96 | | |
| |||
187 | 189 | | |
188 | 190 | | |
189 | 191 | | |
190 | | - | |
191 | | - | |
192 | | - | |
| 192 | + | |
| 193 | + | |
| 194 | + | |
193 | 195 | | |
194 | 196 | | |
195 | 197 | | |
| |||
0 commit comments