feat: enhance config options, support env vars

[Cheelax]

Closes #285

• add support for environment variables (GITINGEST_*) to override config.py defaults
• implement a precedence hierarchy: CLI/Python args → environment variables → default values
• introduce new CLI options (--max-files, --max-total-size, --max-directory-depth).
• centralise environment variable utilities in utils/config_utils.py with functions _get_str_env_var and _get_int_env_var
• add configuration examples to README.md
• tidy and update docstrings
• update tests
• add missing --tag CLI flag
• remove isort in favour of ruff.lint.isort
• remove unused constants BASE_DIR and TEMPLATE_DIR in tests/server/test_flow_integration.py
• rename constant templates to JINJA_TEMPLATES in src/server/server_config.py
• move Colors from src/server/server_utils.py to src/gitingest/utils/colors.py to break circular import chain

[filipchristiansen]

Thanks for your work @Cheelax. I have rebase upon main and added a commit with the following:

Refactor

• Deduplicate _get_env_var by moving it to utils/config_utils.py.
• Remove redundant local_path parameter from _process_file.

Fix

• Add missing tag parameter to _async_main, main, and _CLIArgs.
• Introduce the missing --tag CLI flag.

Docs and consistency

• Update README.md for markdownlint compliance and other minor tweaks.
• Add missing argument docs to _async_main docstring.
• Re-order global variables in config.py for consistency.
• Swap the order of include_patterns and ignore_patterns in parse_query and ingest_async.
• Tidy docstrings for _async_main, IngestionQuery, parse_query, ingest_async, and ingest.

Tests

• Temporarily disable [tool.ruff.lint.isort] due to conflict with the isort pre-commit hook.
• Add new arguments to expected in test_parse_query_without_host.
• Run pre-commit hooks.

TODO

• The environment variable names such as GITINGEST_MAX_FILE_SIZE) do not seem to align with the names used and looked for in _get_env_var`.

• The _get_env_var function returns int | str which causes downstream problems when the variables set with this functions are used (Type "int | str" is incompatible with type "int").

[Cheelax]

@filipchristiansen Hello, any news on this?

[filipchristiansen]

@filipchristiansen Hello, any news on this?

The code crashes when running the server locally, possibly due to a circular import. I will have a look at it.

[filipchristiansen]

refactor(config,lint): centralize env utils, switch to ruff.isort, drop unused constants

• remove isort in favour of ruff.lint.isort
• remove unused constants BASE_DIR and TEMPLATE_DIR in tests/test_flow_integration.py
• rename constant templates to JINJA_TEMPLATES in src/server/server_config.py
• move function definition of _get_int_env_var from src/server/server_config.py to src/gitingest/utils/config_utils.py
• remove duplicated function definition of _get_int_env_var in src/gitingest/config.py
• rename function _get_env_var to _get_str_env_var for clarity
• move Colors from src/server/server_utils.py to src/gitingest/utils/colors.py to break circular import chain

[filipchristiansen]

@Cheelax The branch needs to be rebase upon main

Update: Done

[ix-56h]

LGTM

[ix-56h]

@filipchristiansen i'll let add your review and merge it.

[github-actions]

This pull request has merge conflicts that must be resolved before it can be merged.

[github-actions]

This pull request has resolved merge conflicts and is ready for review.

[github-actions]

This pull request has merge conflicts that must be resolved before it can be merged.

[github-actions]

Hi there! We haven’t seen activity on this pull request for 45 days, so I’m marking it as stale.
If you’d like to keep it open, please leave a comment within 10 days. Thanks!

[github-actions]

Hi there! We haven’t heard anything for 10 days, so I’m closing this pull request. Feel free to reopen if you’d like to continue working on it. Thanks!