feat: add concurrent package processing to speed up indexing

[iggy]

• add workers to parallelize package processing to speed up the index process
• couple other small things I had sitting around in my local tree

[github-actions]

✅MegaLinter analysis: Success

Descriptor	Linter	Files	Fixed	Errors	Warnings	Elapsed time
✅ ACTION	actionlint	4		0	0	0.06s
✅ API	spectral	2		0	0	3.3s
✅ COPYPASTE	jscpd	yes		no	no	2.11s
✅ DOCKERFILE	hadolint	1		0	0	0.12s
✅ GO	golangci-lint	yes	yes	no	no	56.77s
✅ GO	revive	yes		no	no	1.96s
✅ MARKDOWN	markdownlint	2	0	0	0	0.76s
✅ MARKDOWN	markdown-table-formatter	2	0	0	0	0.29s
✅ REPOSITORY	checkov	yes		no	no	41.6s
✅ REPOSITORY	gitleaks	yes		no	no	0.44s
✅ REPOSITORY	git_diff	yes		no	no	0.01s
✅ REPOSITORY	grype	yes		no	no	65.25s
✅ REPOSITORY	secretlint	yes		no	no	0.73s
✅ REPOSITORY	syft	yes		no	no	3.26s
✅ REPOSITORY	trivy	yes		no	no	24.21s
✅ REPOSITORY	trivy-sbom	yes		no	no	3.88s
✅ REPOSITORY	trufflehog	yes		no	no	4.83s
✅ SPELL	lychee	14		0	0	0.13s
✅ YAML	prettier	12	0	0	0	0.9s
✅ YAML	v8r	12		0	0	14.56s
✅ YAML	yamllint	12		0	0	0.78s

See detailed reports in MegaLinter artifacts

Your project could benefit from a custom flavor, which would allow you to run only the linters you need, and thus improve runtime performances. (Skip this info by defining FLAVOR_SUGGESTIONS: false)

• Documentation: Custom Flavors
• Command: npx mega-linter-runner@9.4.0 --custom-flavor-setup --custom-flavor-linters ACTION_ACTIONLINT,API_SPECTRAL,COPYPASTE_JSCPD,DOCKERFILE_HADOLINT,GO_GOLANGCI_LINT,GO_REVIVE,MARKDOWN_MARKDOWNLINT,MARKDOWN_MARKDOWN_TABLE_FORMATTER,REPOSITORY_CHECKOV,REPOSITORY_GIT_DIFF,REPOSITORY_GITLEAKS,REPOSITORY_GRYPE,REPOSITORY_SECRETLINT,REPOSITORY_SYFT,REPOSITORY_TRIVY,REPOSITORY_TRIVY_SBOM,REPOSITORY_TRUFFLEHOG,SPELL_LYCHEE,YAML_PRETTIER,YAML_YAMLLINT,YAML_V8R

Show us your support by starring ⭐ the repository