Skip to content

Conversation

Copy link
Contributor

Copilot AI commented Dec 29, 2025

The cats logger migration removed the success completion log message, making it difficult to confirm successful pipeline execution in monitoring systems.

Changes

  • Added logger[F].info("ETL Pipeline completed successfully") after S3 write operation in EtlPipeline.run()
// Write to S3
_ <- s3Writer.writeParquet(dataStream, outputPath)
_ <- logger[F].info("ETL Pipeline completed successfully")

The message is properly sequenced in the effect system to only log on successful completion.


✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.

Co-authored-by: akreit <64101884+akreit@users.noreply.github.com>
Copilot AI changed the title [WIP] Update implementation based on feedback for cats logger Restore ETL pipeline completion log message Dec 29, 2025
Copilot AI requested a review from akreit December 29, 2025 13:05
@akreit akreit marked this pull request as ready for review December 31, 2025 10:45
@akreit akreit merged commit a68163d into copilot/build-etl-pipeline-scala Dec 31, 2025
@akreit akreit deleted the copilot/sub-pr-2 branch December 31, 2025 10:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants