Skip to content

Conversation

@akreit
Copy link
Owner

@akreit akreit commented Dec 29, 2025

No description provided.

@akreit akreit requested a review from Copilot December 29, 2025 11:56
@akreit akreit force-pushed the copilot/build-etl-pipeline-scala branch from 5b70a60 to afbbbd6 Compare December 29, 2025 11:57
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR migrates the logging implementation from LazyLogging (typesafe scala-logging) to log4cats, a functional logging library that integrates with the Cats Effect ecosystem. The changes make logging effectful and polymorphic over effect types.

Key changes:

  • Refactored CatsLogger trait to provide a polymorphic logger method instead of a fixed IO-based logger
  • Updated all components (S3Writer, EtlPipeline, Main) to use effectful logging via log4cats
  • Simplified DataRepository to a function-based implementation and added doobie derivation for SampleData

Reviewed changes

Copilot reviewed 6 out of 6 changed files in this pull request and generated 5 comments.

Show a summary per file
File Description
src/main/scala/com/async2databricks/utils/CatsLogger.scala Changed from IO-specific logger to polymorphic logger supporting any effect type with Sync
src/main/scala/com/async2databricks/s3/S3Writer.scala Replaced LazyLogging with CatsLogger; made methods polymorphic; converted side-effecting logs to effectful operations
src/main/scala/com/async2databricks/model/SampleData.scala Added doobie Read and Write derivation and necessary imports
src/main/scala/com/async2databricks/etl/EtlPipeline.scala Replaced LazyLogging with CatsLogger; refactored to use effectful logging throughout
src/main/scala/com/async2databricks/database/DataRepository.scala Simplified to function-based implementation; removed custom Read instance (now derived); removed unused imports
src/main/scala/com/async2databricks/Main.scala Updated to obtain logger instance explicitly for IO effect type
project/plugins.sbt Downgraded sbt-scoverage plugin version

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

Copy link
Contributor

Copilot AI commented Dec 29, 2025

@akreit I've opened a new pull request, #4, to work on those changes. Once the pull request is ready, I'll request review from you.

Copy link
Contributor

Copilot AI commented Dec 29, 2025

@akreit I've opened a new pull request, #5, to work on those changes. Once the pull request is ready, I'll request review from you.

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 6 out of 6 changed files in this pull request and generated 2 comments.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Copy link
Contributor

Copilot AI commented Dec 29, 2025

@akreit I've opened a new pull request, #6, to work on those changes. Once the pull request is ready, I'll request review from you.

Copilot AI and others added 6 commits December 29, 2025 12:19
Co-authored-by: akreit <64101884+akreit@users.noreply.github.com>
…ambda

Co-authored-by: akreit <64101884+akreit@users.noreply.github.com>
Fix DataRepository to return trait implementation instead of lambda
Properly sequence logging effects in S3Writer
Copy link
Contributor

Copilot AI commented Dec 29, 2025

@akreit I've opened a new pull request, #7, to work on those changes. Once the pull request is ready, I'll request review from you.

Copilot AI and others added 2 commits December 29, 2025 13:03
Co-authored-by: akreit <64101884+akreit@users.noreply.github.com>
Restore ETL pipeline completion log message
@akreit akreit merged commit 092609d into main Dec 31, 2025
1 check passed
@akreit akreit deleted the copilot/build-etl-pipeline-scala branch December 31, 2025 10:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants